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ABSTRACT ' ^ 

A study was coi ed to develop a process evaluation 
model for Bilingual Vocational grams (BVPs) in Florida. Literature 
was reviewed that concerned stat* evaluation of general, vocational, 
and bilingual vocational education. This information and information 
from interviews and correspondence on these areas were used to 
develop a questionnaire that identified the additional needs of BVPs 
as compared with traditional vocational education programs. The . 
questionnaire was also designed to identify standards and criteria, 
which, when met, would indicate that effective bilingual/vocational 
education ( BVE ) and/or vocational education for the limited English 
proficiency students was being provided. New York City BVP 
instructors and administrators participated in the pilot test of the 
bilingual Vocational Instructional Program R-»vitw Component (BVIPRC) 
which contained those standards and criteria identified. Based on the 
Vocational Education Instructional Program Review, the BVIPRC 
includes a self evaluation component and on-site review. (A copy of 
the BVfPRC is provided.) The revised BVIPRC was field tested with BVE 
personnel in Florida. A total of 69 BVE staff participated in the 
study — 35 completed the questionnaire and pilot tested the BVIPRC, 34 
participated in BVIPRC field testing and evaluation. (Appendixes 
include questionnaire materials and BVIPRCnield test and pilot test 
materials.) (TLB) 
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Abstract 

The segment of the United States population categorized as 
Limited English Proficiency (LEP) is characterized by a nigh unem-' 
ployment rate and a large number of secondary school dropouts. 
Unijfcad States Congress has provided funding for special programs 
including the 1976 Vocational Education Amendments (VEA) to the 1963 
Vocational Education Act which earmarked funds for the LEP popula- 
tion in the form of Bilingual Vocational programs,. This amendment * 
also mandated the evaluation of all funded areas. 

The survey conducted during this stutfy identified the lack of 
state models for the evaluation of Bilingual Vocational Education 
Programs (BVPs) . The slate uL Florida, in order to comply with the 
1976 VEA, authorized the development of Bilingual Vocational Tnstruc- 
tional Program Review (BVIPR) . 

This study addressed: a) the identification cf the standards 
and criteria necessary for quality BVPs and b) the development of 
the BVIPRC. 1 

The rationale for this study was developed from the theory that 
evaluation is a process that can lead to development, improvement, 
and rational decision making for educational programs. 

Data were obtained in three phases from personnel involved in 

the instruction of LEP students in the state "of Florida. A result o: 

this study was the development of the BVIRPC. .This component included 

the standards and criteria needed for quality BVPs as well as those 
♦ 
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.required for vocational education, as identified for the state of 
Florida. * 

The Florida Bureau of Vocational Research, Dissemination, and 
Evaluation staff provided the funding that developed this first state 
model that has incorporated the special needs of the LEP students 
enrolled in vocational programs. This model provides the standards 
and criteria, which, when met, will provide quality BVPs; 
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CHAPTER I 



INTRODUCTION 

-The segment of the United States population* cate- 
gorized as Limited English Proficiency (LE?) has been 
Characterized by a high unemployment rate and- a large number 
of secondary school dropouts. This group also has "the 
tendency . . . i*6 end up in entry level skill occupations 
where employment is irregular and salaries are low 11 
(United States Department of Labor Report, 1976.) 

In addition, the 1978 National Center for Educational 
Statistics (NCES) report stated that: (a) one in ten 
children between tne ages of 6 and 18 is from a non-English 

9 

language background, (b) '23 states have at least 10 language 
minority populations; and (c) two put of three members 
of the identified LEP populations were bcrn in the United 
States, Puerto Rico, or some other United States territory. 
The report further stated that "young language minority persons 
appear tq, be educationally disadvantaged on two key measures: 
School grade attainment for (their) age, and dropout ra^e. ,( 
The average dropout rat3 for the Erfgiish speaking students is 
approximately 10% of the total population (ages 14-25+*. 

I 



whereas students with limited English backgrounds have a 
30 to 40% dropout rate. Thus, the probability of LEP 
students dropping out is substantially greater than that of 
students whose dominant language is English (NCES, Sprang* 
1978, p. 1) . 

The LEP population is composed of -22 major language 
groups plus a large number of minor ones. The largest 
group or LEP minorities is Hispanic, Of the five million 
identified LEP persons in ^h6 United States, three million 
are of Hispanic origin, Hispanics have a school dropout rate 
of 45%. This is especially relevant to the state of Florida, 
one of the nine states in which 90% of the United States 1 
Hispanic population is located (NCES, Spring 1978, p, 1), 

The 1974 Bilingual Education Amendment tc the 1968 
"lementary and Secondary School Act (ESEA) and the 1962 
Vocational Education Act (VEA) , as amended in 1976, earmark 
specific funds for the LEP populations. In addition, the -State 
of Florida has provided specific programs for the LE? popula- 
tion on a lcc^l basis. These programs, identified as Silm- 
guaS' Vocational^ Education Programs (BVPs) , provide students 
with occupational training and the opportunity to improve . 
their English language skills. Bilingual Vocational Fducation 
(training) was defined by the 19 76 Vocational Education 
Amendment as: 

Training or retraining in which instruction 

12 



is presented in both the English lanauage and 
the dominant (target) language % of the persons 
receiving training and which is conducted as 
part of a program designed to prepare indivi- 
duals for employment. 

The students served by BV5 are individuals of 
ited English Speaking Ability "(LESA). lesa is defined 
by the 1976 Vocational Education Amendment as : 

1. Individuals who were not born ir* the United 
States or whose native tongue is a ianguage other than 
English. ^ 

2. Indivir ;als who came from environments 
whe^e a language other than English is dominant; and by 
reasons thereof, have difficulties speaking and understanding 
instruction in the English language, LESA was changed 

to Limited English Proficiency (LEP) by the November 1, 
1975 Public Law 95-561, of the Blingual Education Act. 

F 

The state of Florida has no state level definition 
for 3VE or specific policies on how the needs of the LEP 

students were to be met. Each school district board 

*, 

within the state determines how they will meet the need, 
of the U2P students enrolled in vocational programs. Two 
examples are: 

1. Dade County provides some vocational programs 
m the target language; and 
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2. Escambia County jrequires students to enroll in 

« 

ESL programs and obtain a minimum English proficiency 
before entering the vocational class (Kandarakis , Telephone 
Interview, 1981) . 

*"*SVE programs, in this study, are defined as 
those programs with LEP students enrolled or desiring enroll- 
ment. Traditional VE programs are defined as vocational 
Drocyrams in which the students speak, read, and write 
the English language. Bilingual programs funded by the 
3ilingual Education Amendment^ Title VII (1974) to t^e 

Elementary and Seccmdary SCflool Act, are not addressed. 

c 

Background of the Problem 

. w 

Accountability for vocational education in all areas 
has been mar . ^d by the federal government for all state 
departments or education. In order for states to- receive 
funding- under the existing Smith-Hughes Act an^ the 1963 
Vocational Education Acts (VEA) , as amended in 1976, a plan 
for the evaluation of all areas funded under these bills must 

"Si 

be developed. This act places an emphasis on the validation 
of Services to socially, economically, and educationally dis- 
advantaged persons, including those with LEP, with respect to 
their participation in vocation- education. 

The personnel in the Division cf Vocational 
Education of the State of Florida, in order to comply with the 



19 7 6 VEA specifications, developed in the "Florida State Plan 
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for Vocational Education/ 1 often referred to as the 
Florida Five Year Plan for V ocational ^ucaftion . This plan 
is ^reviewed each year according to, specific criteria and 
changes are made accordingly (Giehls, Personal Interview, 
1980). [ The plan requires that the Division of Vocational 

A 

Education conduct "state evaluation of programs in an effort 
to: (• 

.provide effective and efficient implemen- 
tation anck needed modification of vocational 
programs, services and activities, evaluation 
must be systematically designed and conducted 
to provide information in quantitative ter*ms 
regarding the^^aklocation of human material 
resources (Florida State Plan for Vocational 
Education, Part A, 1978, ^1^/ p. 18). 

The Division of Vocational Education, in compliance 
with these regulations, 'developed a process model for the 
evaluation of Vocational Education (VE) programs in the State 
of Florida at all levels: high school, vocational technica'l 
schools, and community colleges (Vocational Education 
Instructional Program Review, 1980-81) . The criteria and 
standards specified in the model for the evaluation of voca- 
tional education had not" been examined with , reference to the 
evaluation needs of BVPs. 
Significance of the Problem 

m The Florida Department of Education, Division of 
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Public Schools (MIS Statistical Report, Series 8 0-15', March 
1980) has identified 28 #105 stud-ents with LEP in the state. 
These statistics apply to the status prior to the 1980 Cuban 
and Haitian influx, £he effects of which, at the time of this 
writing, have not been officially evaluated with reference to 
the LEP population in Florida, This researcher conducted a 
telephone survey between iMay 21-^1, 1980 to identify existing 
BVPs in the State of Florida, Results revealed a concern by 
vocational personnel in many areas of the stat.e regarding 
their ability to provide services to the anticipated influx 
of these new LZP people (see Appendix A). "From 80,000 to 
105,000 refugees from the Cuban exodus have settled ^in Dade 
County or just over its borders, straining the facilities 
of the area (including education) of 1.6 million people." 
( New York Time s, April 19, 1981, p.l) . Additionally, inter- 
views with vocational personnel in Florida revealed their 
belief that the new LEP population would have difficulty 
obtaining employment without adequate English communication 
skills and vocational' training. The vocational skills required 
by those vocational personnel are those suitable to the 
region in which the new LEP population plans to settle. 

The need for BVPs in the State of Florida has been 
recognized by the educational personnel in the district 
.presently conducting these programs (see Appendix B) . 
These bilingual vocational education programs, though 
vocational, presented a new dimension that was not incorporated 
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into the existing process model for evaluation of vocational 
.education within Florida. 

In addition, telephone and personal interviews 
(see Appendix C) anci the review of literature had failed 
to identify any models fo^ the specific evaluation of BVEPs a 
the state level -in the United States. This was confirmed 
by a state-by-state inqfuiry of vocational education 

v 

departments. m 

Purpose of the Study • 

The purpose of this, study was to develop a process 
evaluation model for BVPs in the State of Florida. The 
model includes those criteria and standards, identified 
during the study, as necessary for effective BVPs, in 
addition to the ones required for vocational education 
by. the State of Florida, Department of EducaVion. 
rationale and Theoretical Framework' - 

The rationale for this study was developed from the 
view that y evaluation is a process that can lead to 
development, improvement," and decision making for educational 
programs. Accountability for education became a mandate for 
many educators through the provision of the Elementary and 
Secondary Education Act (ESEA) of 1976, 

The theoretical cAiceptualization of evalua"tiQn 
has been explicated and researched by such educators as 
Scriven (1976) , Hananond (1969) , Stufrlebeam (1971) , and 
Provua (1971), while- £he concept itself appeared even 
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.earlier in the education process (Tyler, 1342). 

From evaluation theories, pragmatic evaluation 
models evolved, and the research conducted with these 
models has established evaluation as a means for developing 
and improving educational programs and decision making 
(Stuf f lebeara, 1971) . Evaluation has also becom^ a means 
'for meeting accountability requirements at both federal and 
state levels, e.g., the requirements for evaluation 
specified in the ESEA (1965) with its 1974 amendments 
and VEA (1976). Thus, ,the staff of the State of Florida r 

Department of Education, Division of Vocational Education, 

> 

provided for the development of the Vocational Education 
Instructional Program Review — a process mo^el; Pennsylvania, 
a discrepancy model; and Michigan, an adaptation of 
Stuf f lebeam's Context, Input, Process, and Product - (CIPP) 
Evaluation Model for total program evaluation. Based on 
the research conducted for this study, a specific type(s) 
of model (s) optimal for meeting^accountability requirements 
had not been determined. 

^ Five methods were identified by Smith (1979) as com- 
monly used for the evaluation ,of federally funded programs: 
(a) 'system, evaluation, (b) program evaluation, (c) person, 
evaluation/ (d) product evaluation , and (e) other/mixed. 
Each evaluation approach, though different, can be used for 

i 

the purpose of meeting accountability requirements in the event 
that the methodology is nor pre-specif ied. The approaches 



identified on the previous gage are defined as follows: 

1. System Evaluation : "Evaluation necessary m 
providing information for decisions abcut the state cf a 
system" (Alkin, 1969).. It is used to determine the 
difference between the desired situation .and the true out- 
comes of program or project. This is a form of .prpduct eval 
uatipn or the macro level. ■* 

2. Program Evaluation : ..Evaluation on the micro 

or local level. Thfe specific program- ox. project is- "examined 
with reference to the desired outcomes. The use of process 
evaluation is the evaluation of the treatment by looking at 
it instead of the outcome (product) (Scriven, 1979) . It 
is also referred to as formative evaluation when conducted 
during the development for improvement of a program 
(Scriven, 1977). 

3. Person Evaluation : Evaluation of personnel, 

4 

trainees, clients, and others who are involved in the 
program or project. The focus here is on the personnel 
ievel instead of an a program or system* level (Sgiith, 1979) 

4 . Product Evaluation ; Measurement and interpre- 
tation of attainment at the end of the project cycle 
(Stuff lebeam, 1971) . 

5. Mixed ; , Incorporation into the evaluation 
procedures of mora than one method, These approaches enume- 
ratrid by Smith (1979) ace further supported by the rationale 
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presented by the experts. 

Tyler (1942) "presented evaluation as a system 
whereby decisions could be, made based on the/tJSfcgruence 
between the stated objectives ana the measured outcomes. , 
In addition to that, Scrivetf (1976) proposed the idea of 
"goal free" evaluation/ the purpose of which is to provide 
for the inclusion of the unintended outcomes in the 
program evaluation and decision making. Thus, goal free 
evaluation is conducted by an evaluator who has not been in- 
formed of the program* s specific goals. In this approach 
the merit of. the program is determined through total 
evaluation. 

Stuff lebeaxn et al. (1971) developed a model for 
total program evaluation from its initial inception to 
final product. The rationale was presented in the CIPP model 
for program evaluation (Stuff lebeam, 1971) . K\ overall 
program evaluation approach is also presented by Stake (1967) 
v/hose "Countenance of Education Model" provides the description 
of intents* and actual observations and the use oi standards or 
'he basis of which judgements are m*de about a program or 
product. 

Hammond (1969) presented a model* fbr local evaluation 
to determine program effectiveness in terras of how well 
desired objectives • have been obtained. This model cauld be 
expanded to an evaluation of programs on the state level to 
provide accountability to the federal funding source in the 

20 
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sane way it could be used by the community to provide 
accountaQility to the state funding source. 

Provus (1969) referred -to the use gf performance 
(product) against desired outcome (goals of the program) 

to determine whether to improve , maintain or terminate a 

It- 
program. His model has been identified as the "discrepancy 

model." 

The models mentioned here and their relationship to 

the systems identified by Smith are represented in Figure 1- 

"1 / 
The figure illustrates the models that may be used by the 1 

programs to meet their need for accountability. It further 

diagrams ,the partial program evaluation thrft is acceptable for 

meeting the federal accountability standards. For example , 

the program that adapted Stuf f lebeam' 9 c/pp model or Scriven's 

Formative Summative Evaluation model woil.d be conducting four 

evaluation procedures ^ The modiels of^rovus- Tyler, and Hammond 

would incorporate tw« evaluation procedures, and Stake's only one. 
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Figure I. Relationships of evaluation systems and models. 



ERIC 



21 



12 

The'models developed by Stake, Scriven, Provus , 

Hammond, St^fflebeam, and Tyler are examples of the use 

of evaluation for the purpose of accountability. A 

synthesis of the goals and objectives of .these models is 

- > 

stated. by this researcher -;s a methodology for describing, 
obtaining, and providing information for making judgments 
and determining . the worthof a program or project. * / 

The evaluation framework proposed in thig study, 
which draws on the theories and models presented by these 
theoreticiaris, is designed to provide a system that 
"meets the accountability demands of the state and federal 
agencies as well as permits informed decision making. 
Limitations of the Study 

This study was conducted for the State of Florida. 
The generalizations made with respect to findings and 
state programs may be of limited use to other states due 
to differing geographic regions and population composition. 
The participants were in programs identified through the 
initial survey and chaining procedures. It is, possible 
that there are other types of programs that were not 
identified. 
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CHAPTER II | 
' REVIEW OF LITERATURE 

The review of literature for the evaluation of 
BVE was based on an examination of the available literature 
on state evaluation of general education, vocational educa- 
tion (VE) , and bilingual vocational education (BVE)* Further 
information was obtained through personal and telephone 
interviews and correspondence, including a letter to each 
state director of vocational education. 

The literature reviewed , correspondence received , 
and ^interviews conducted confirmed that state evaluation 
exists on the levels of general education and vocational 
. education. Thirty state directors responded to the 

letters; of these, five provided state program evaluation 
models that make specific reference to the needs of the 
LEP students, who are enrolled or desire to enroll (New 
: orl^, California, Michigan, Delaware, and Colorado). 

• The purpose of evaluation was- defined by the 
leaders in the field in .several ways.. Tyle* (1942), 
Stufflebeam (1968), and Cronbach (1963-) referred to 
evaluation as decision making process, Alxin (1^69), 
Aster and Pano (1971), Provus (1971), Scriven (1977), 
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and Stake (1967) added the dimension of program improve- 
ment to decision making and to the purpose of evaluation | 
Thus, evaluation may be defined as a process used to 
initiate improvements and to make decisions with reference 
to an ongoing program or project. Another definition of 
evaluation rafets to totel program development. This 
concept is well represented by the models developed by 
Stufflebeam (1971), Scriven 0966) * Provus (1971), and 
Stake (1967). These models provide the ideal method of 
program^evaluation, though not necessarily the methodology 
used in program evaluation today. Worthen and Sanders 
(1973) defined process evaluation as a means of meeting 
the following-, threff objectives: (a) to detect or predict 
defects; (b) to provide information for decision making; 
and (c) to maintain a record of the procedures as they 
occur. 

State evaluation models, developed to meet the 
Elementary and Secondary Education Act (ESEA) requirements, 
were not standardized in their purpose or methodology. 
The Pittsburgh, Pennsylvania Public School Model, developed 
by Provus (1969) , was a discrepancy model in contrast to 
the Saginaw Public School Model that was based on 
Stuff l'ebeam's CIPP Model (Context, Input, Process and 
Product) . The Pennsylvania and Saginaw Public School 
iModels meet ttfie evaluation requirements of ESEA , but 
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reoresent different concepts of educational evaluation. 
The Saginaw model provided for full evaluation of pro- 
grams extending from the determination of need (context) 
to the outcome (product) . This type of model provided 
for continuous evaluation and/or ad hoc evaluation # the 
Pittsburgh model, a discrepancy type model, only Records 
differences befefreen the intent and what is being done. 

Evaluation as represented by the models of 
Stuff febeam, Scriven, and Stake is not necessarily rep- 
licated in the evaluation systems implemented today. 
The purpose of evaluation is generally conducted to obtain 
educational funding from sponsors that mandate its 
inclusion, such as the ESEA, VEA, and Title VII. 
Wently (1970) stated that "evaluators usually get a copy 

of the funding proposal and . . . say this is the design, 

o 

let's go see if this is happening."' This type eval- 
uation, though valid (Borch, 1977; Provus, 1971), does 
not discover unintended positive and negative outcomes. 
Stuff lebeam (1971) refers to this as the "no significant 
difference syndrome " and cites the Higher Horizons program 
in New York as an example. The program evaluators found 
no significant change, whereas the teachers, parents, and 
administrators believed the program was a success. 

The models for present day program evalua- 
tion are often a composite of the traditional models. 
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For example, Borch (1977) used Alkin and Stake for his 
basis, but believes evaluation should answer only those 
questions that are specified through the goals of the 
program developer and/or implementors . 

The categories that the researcher believes 
provide program evaluation are: (a) process evalua- 
tion; (b) product evaluation; (c) total program evaluation; 
and (d) stratified program evaluation (the use of only 
the program goals ^and objectives in the evaluation design) . 

The use of program evaluation by the states was 
mandated by the Elementary Secondary Education Act (ESEA) 
in 196$ and its 1974 amendments. States receiving funds 
under the ESEA and VEA were required to develop evaluation 
procedures, providing d$ta for the accountability of their 
spending. The evaluation models developed to meet the^se 
requirements have a combination of several categories of 
evaluation .4 Florida's Vocational Education Program Review 
is a process evaluation model, whereas the New Jersey 
State Model is a process-product evaluation model (New 
Jersey State .Education Department, May 1980). 

Thd evaluation of education implies the evaluation 
of each component of the educational enterprise: special 
education , bilingual education , vocational education , and 
others. Each of these components represents different 
needs that ^ should be considered in the development of a 
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state evaluation design. The two components that will 
be considered in this study are vocational education 
and bilingual vocational education. 

As with general education, a primary purpose 
for evaluation of vocational education is a basis for 
funding. The 1963 Vocational Education Act, as amended 
in 1968 and 1976, mandated that evaluation be included 
in the vocational education system. Evaluation of 
vocational education has been implied since the passage 
of the Smith-Hughes Act of 1917. This act required the 
creation of the State Board of Vocational Education and 
the preparation of plans outlining necessary qualifications 
of instructors, facilities, equipment, and supplies to be 
used in the course of studies and teacher training plans. 
This board was to submit a report to the federal govern- 
ment outlining the year's accomplishments and detailing 
how the funds were spent. Each state complied- but the 
data were not collected in a usable manner (Datta, 1979). 

The 1968 Vocational Education Amendmf it (VEA) , which 

mandated for a more structured type of evaluation, was 

r 

an outgrowth of tne Great Society's manpower and poverty 
programs (Evans, 1974). The other educational phenomenon 
that affected educational evaluc.^ion was the demand for 
accountability in education. According to Evans (1974), 
"it is hard to determine if the increase in evaluation 

27 
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caused the demand for accountability or the increased 
demand for accountability caused an increase in evalua- 
tion. " 

Hoyt (1976) suggested that the total educational 
system has a new permanent component — evaluation. This 
is supported by the 1970 reorganization of the United 
States Office of Education that centralized evaluation 
staff and funds, housing them in the Office of Planning, 
Budgeting, and Evaluation (OPBE) . This was the beginning 
of mandated third party' evaluation for federally funded 
educational programsL. The creation of the OPBE was tech- 
nically che beginning of the thrust of program evaluation 

into the educational domain* The actual statewide prograrp 

I 

evaluation models still ^present "process" (Starr, 1970) . 
This is exemplified by the models of Florida (1980) and 
California (1979>. Starr stated that the "state model 
for vocational evaluation is best exemplified by a process 
product evaluation." The 197,6 VEA offered the latest 
support for the implementation of evaluation of the 
federally funded projects. 

Programs funded by the 1976 VEA required the 
inclusion of evaluation for vocational guidance and coun- 
seling personnel, preservice, and inservice training, 
renovation cf facilities, grants to overcome sex bias, 
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and funds to assist state planning. "The amendments 
also created new evaluation and accountability require-, 
ments (Datta, 1979) . * 

To meet the new requirements, the State oi Florida 
has developed a process model for the evaluation- of voca- 
tional education programs (1980,-81) . Illinois (Bulletin 
#35-971), Massachusetts (1969), Ohio (1973-74), New 
Jersey (1977)* also have or are in the process of develop- 
ing models to evaluate their vocational education programs. 
These models are process or process-product evaluation 
and have three major areas of concern: (a) staff, 
(b) materials, equipment and supplies? and \*c) curriculum. 
The general purpose of all cf these models is to provide 
states with" information that 'will enable them to improve 
and/or make decisions on their vocational education 
programs. 

General education and vocational education have 
' een evaluated with reference to local and national cri- 
teria and standards. The new member of the family, 
bilingual vocational education, has yet to be fully 
evaluated on a state or national level. 

The purpose of BVE is to provide training to 
persons of Limited English Proficiency (LEP) who are 
unemployed or underemployed and unable to bdhefit from 
traditional English training ( Abstract of the Bilingual 1 



2D 



✓ 



' 20 

Vocational Training Grants, 1978 , Bureau of Occupational 
and Adult Education, Division of Research and Demonstra- 
tion Branch)- The additional aim of BVE is to improve, 
the English of participants during the time they ate 
learning a skill. 

The objectives, as synthesized by this researcher 
from the review of federal and state project materials, 
are: * j 
~ 1. To provide transitional BV£ training till 

such time as they can enter the traditional VE. 

2. To provide English as a Second Language (ESL) 
training concurrently with vocational training 

3. To provide students with entry level skills 
fcr the occupation of their choice 

4. To provide students with vocational English 
skills in both oral and written areas of communication 

5. To provide students with skills to pass 
licensing or certification examinations as necessary 
and " 

6. To pro^de hands-on experience for those 
students who need it in order to obtain the occupational 
skills (Occupational Instruction for Limited English 
Speaking Ability LESA, No. 81702 and 81705, New York 
City; Bilingual Training Out-of School Youth and Adults 
in Occupational Areas, Grant No. G-007702037, Westbury, 
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New York; An Exemplary Program of Expanded Bilingual 
Occupational Education Opportunity by-way of the Team 
Teaching Approach, Project No. COTQ-D-721 and C077-D-721; 
Bilingual Chinese Chef Training Program, New York City: 
1978-79 Interim Report;. Bilingual Vocational Guidance and 
Education, Needs Assessment in Michigan, Eastern * Michigan 
University, Contract No. 33C8-7442-6; Fitchburg State 
College BilinguaJ. Vocational Training Program, 1976) • 

The five state models identified as having 
re f erence to LEP students ^represent three types of 
models : 

1. Michigan 

Needs Assessment (a determination of need) 

2. New York, Delaware, and California 
Process Models (a look at the treatment 

rather than the outcome) 

3. Colorado 

Discrepancy Model (to identify gaps 
between objectives and actual situations) 

These models, though different, meet the 1977 VEA require- 
ments for developing an evaluation model by 1982 for the 
LEP population enrolled^ or desiring enrollment in VE 
programs. 

The process models identified the, following areas 
for state level evaluation: instruction (not necessarily 
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bilingual), facilities, materials, equipment, supplies, 

I 

recruitment, counseling , placement, follow-up, demo- 
graphic data, admission procedures, teacher qualifications 
inservice courses for staff, advisory council, student 
organizations, program completers and leavers, and 
support services. The methodology used in each model to 
determine if the student's needs in this are?, are being 
provided are different. For example, the Delaware and 
Colorado models evaluate instructional materials in 
different ways. 

Delaware and Colorado refer to the needs of the 
LEP students enrolled in vocational programs in their 
general vocational program evaluation models. These ' 
models emphasize process evaluation procedures, a form 
.of evaluation that is often used by the state evaluators., 
when reviewing vocational programs , i.e., New ¥ork, Maine, 
and California. The process models that are employed in 
the various states do not use a uniform set of standards 
and criteria that could be used for comparison of programs 
between states. The models of Delaware and Colorado pro- • 
vide an example of this in their methods of evaluating 
instructional materials. 

The instructional mater ials 'are evaluated by the 
Delaware state evaluation personnel using the state model 
in reference to bias toward sex, race, LEP, disadvantaged, 
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handicapped, and minority groups. The Colorado evaluation 

personnel, using their state model, refer only to* 

sex fairness "of school publications, promotional brochures , 

and literature contents. The Colorado model also includes 

the review of tests to eliminate those containing sex 

bias. 

Although both 'states refer to the needs of the 
LEP in vocational education, only the Delaware model 
includes their needs with reference to instructional 
materials. This example shows that the lack of uniform 
standards and criteria for evaluation permits the individ- 
ual states to determine the areas for investigation in 
reference to needs of all vocational students, including 
the LEP. 

The State of Florida Vocational Education Instruc 
tional Program Review, a process evaluation model that was 
being employed by the Bureau Vocational Research, Dissemi- 
nation and Evaluation consultants for program review of 
all programs, did not include the specific needs of the 
LEP students. In addition, the standards and criteria 
necessary for school programs to be refunded were only 
those necessary for Full Time Equivalent (FTE) funding 
(Harrell, Interview, 1981). The Bilingual Vocational 
Instructional Proaraxn Review Component (BVIPRC) developed 
d. "ing this project is based on the Florida State 
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vocational Education k Instructional Program Review Model 

as mandated by the State of Florida, Division of Voca- 

tional Education which sponsored this project. 

0 

Since no standardized method for the evaluation * 
of BVE (Troike, Interview, 1980; Babcock, Interview, 1990; 
Hannenburg, Interview, 1980) v was identified, a need for 
validated standards and criteria was perceived for uni- 
form evaluation of Bilingual Vocational Programs ( BVP ) 
by state evaluators. ' The need for BVPs for the LEP stu- 
dents is supported by the finding of Rios and Hansen 
C1977) who stated that LEP individuals are underemployed, 
undereducated, and lacking in work experience. They 
further explained that this population has a "severe 
disadvantage in preparing for a role as functional citizens; 
their social and employment roles are extremply limited. " 
To meet the needs of its LEP students, the state of 
Florida's school districts have established BVPs. 
These programs, though implemented , have not been examined 
at the state level to determine if the needs of the liEP 
stud^ntd enrolled in these programs are being met 
(Giehls, Interview, 1980). 

Summary of*th w e Review of 
Literature 

The major funding for vocational education and 
BVE is the 1976 VEA which mandates evaluation of all 

# 
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funded programs. The states of Michigan, New York, 
Delaware, California, and Colorado have established 
vocational education evaluation models that include 
reference to the needs of the LEP students* The diver- 
sity in the models — Needs Assessment, Process Models, and 
Discrepancy Models — do not provide a standardized n\ethod- 
ology for the evaluation of BVE or VE programs with LEP 
students* 
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CHAPTER III 



METHODOLOGY - - 

The study was conducted in tht^/phases: 
(a) the identification of additional staff, staff skills, 
material, equipment, supplies, and curriculum components 
for Bilingual Vocational Education Programs (BVPs) 
that are not necessary for traditional Vocational Educa- 
tion (VE) ; (b) the identification of the standards and 
criteria which, when met, would result in effective 
BVPs; and ic) the development of a component of the 
Vocational Education Instructional Review to be used 
for the evaluation of BVPs in the State of Florida. 
Phase I 

The additional needs of BVPs, as compared with 
traditional VE programs, were identified by the use of a 
questionnaire. The questionnaire was designed to provide 
the respondents with the opportunity to express whether 
or not they believe additional staff, staff skills, 
materials , facilities, equipment, supplies , and curriculum 
components are required fcr BVPs in comparison to those 
required for traditional VE programs. . 

26 
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The questions that this aspect of the study 
was desrgned to answer were as follows: 

1. What were the requirements for staff in BVPs 
In addition to those that are required for traditional 
vocational staff in the State of Florida? 

2. What were the facilities, equipment, and 
materials needed 3r the instruction of Limited-English- 
Prof iciency (LEP) students in vocational education' in 

. addition to those required for English speaking students 
in the State of Florida? 

3. What curriculum components were needed for 
the instruction of LEP students in vocational education 
in addition to tiiose required for the English speaking 
students? 

Phase II 

The additional standards and criteria^ for BVPs were 
initially identified through the review of literature, 
interviews, and correspondence. Once identified, these 
standards and r criteria , along \p.th those stated in the 
Vocational Education Instructional Program Review (1980) 
for the State of Florida, were also included in the initial 
questionnaire. The questionnaire was designed to record 
the participant's belief as to the standards and criteria 
necessary for effective BVPs in the State of Florida. 
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The questionnaire was developed £o provide the 
respondents with the opportunity to determine the area 
to which the standard is most appropriate: BVE, VE, 
both, or none. For those standards identified as appro- 
priate for AVE or both, the respondents were asked to 
express the degree to which they agreed that thfe specified 
criteria were appropriate for meeting the standard. 

» The question that this aspect of the study was 
designed to answer' was: What, if any, additional stan- 
dards and criceria relevant to BVE and VE have not been 
incorporated into the Florida Program Review? 
Phase III - 

The third phase of this study was the development 
of a component for the evaluation of BVPs in the State of 
Florida. Vhis component is composed of three sections 
to correspond with the Florida Program Review. These 
three Sections include: (a) program self -study; (b) on- 
site visitation; and (c) post-visit activities; review 
of^findings with Administrator, when possible. 

The BVE component includes tTte>tftandards and 
criteria identified in part one as relevant to BVE and/or 

r 

BVE and VE in addition to those in the Florida Vocational 
Education Program Review. The additional steps that 
were required for the completion of this section are 
as follows : 

« 
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1. Develop the BVE component for the VE Instruc- 
tional Program Review for Florida 

2. pilot test the component 

3. revise the component ^ 

4. field"±«st revised component and evaluate 

results 

5. prepare final component. 

The question that this phase of the study was 
designed to answer was: Does this component, developed 
for the evaluation of BVPs in the State of Florida, 
provide some assurance that effective programs are being 
conducted? The BVP component was evaluated by the BVP 
personnel who participated in its pilot and field test 
efforts. The evaluation consisted of a response form 
that was completed by the researcher during the on-site 
conferences during the pilot test and an evaluation form 
that was completed by the participants during the field 
test, self-evaluation segment, in the pilot and field 
test of the BVIPRC. * 1 

The pilot test consisted of- the participants 
completing the self-study form and the on-site "visit by 
the researcher. During the on-site visit of post-visit 
activity, the researcher and the participant (s) conferred 
on the reliability of interpretation of the instrument 
and validity of the standards and ^criteria . Each standard 
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and criteria were reviewed by the participant (s) and 
researcher to evaluate the respondent's interpretation 
of the standard and criteria. Additionally, the partici- 
pant identified the area to which the criteria were most 
relevant, i.e.,3V|/VE, BVE only, ESL only, o£ not 
appropriate for vocational programs with LEP students 
enrolled. Any qualifying statements that were made by 
the respondents were also noted. 

The data obtained from the validation of the 
criteria for their standards were analyzed by cumulative 
frequency and percentage. Each criterion that was selected 
by a minimum of 60% of the respondents for BVE /VE 
plus BVE only was perceived as valid by the respondents. 

The. field test of the r T 'lPRC consisted of the 
participants completing the revised self-study forth and 
the instrument evaluation form plus the on-site visit by 

; . . * 

the researcher. During the on-site Visit, or post-visit 
activity the researcher and the respondents reviewed the 
instrument to evaluate the reliability of its interpreta- 
tion. The evaluation forms were collected and reviewed 
at a later date. 

The analysis of data from the evaluation of the 
BVIPRC was by cumulative frequency and percentage. The 
respondents who evalvated the instrument expressed 
their belief as to whether or not the -Objective , as 
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stated in the evaluation instrument , had been met by the 
implementation of the BVIPRC. An objective was perceived 
as met when 60% of the responses "agreed" that it was reached, 
the instructions for the evaluatiori^of the BVIPRC also 
requested the participants to make suggestions on the areas 
to be included or methods of program review that would improve 
the BVIPRC* 

Identification of Bilingual Vocational 

Education Programs in Florida ' ^ 

The initial programs and population for this- study 
were ident fied through a survey of the educational dis- 
tricts in Florida. Vocational Directors , or Program 
Administrators were interviewed in each of the 67 districts 
md 33 community colleges in the State of Florida. The 
results of the analysis of the information from the inter- 
views identified 12 progr -r.s, two of which were not 
refunded for the 1980-81 school year. Additional programs 
and staff were identified during the study by chaining. 

Selection of Programs for 
the Population - " 

Staff members in the initial BVPs in the State 

of Florida were requested to participate in the study. 

The programs selected were those whose staff were willing 

to participate. Since the total population — the staff in ■ 

each identified program — was requested to participate', 

the sampling procedure was eliminated. 
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The final phase of 'this study, the development of the 
BVE component of the Vocational Education PrQgram — Review — 
required the identification of two groups of participants to 
provide pilot testing and field testing. The initially identi 
fied personnel were used in the pilot test. The field test 
was conducted with the newly identified personnel. The new 
participants were identified by chaining, the requesting of th 
initial participants to designate additional BVE staff within 
their school or at other locations • This provided for further 
validation of the instrument - reliability of interpretation and 
validity of the standards and criteria by personnel that had ± 
not been contaminated by previous exposure to the instrument. 
Research Design 

The identification of additional staff members, 
staff skills, materials, equipment, supplies, curriculum 
components, standards and criteria for effective BVE in 
the State of Florida was completed by the use of a ques- 
tionnaire that was administered by the researcher. The 
steps taken to complete this part of the study were as 
follows: 

1. A questionnaire (QI) was designed to obtain 
a consensus on the additional requirements of BVPs in 
the State of Florida. The initial draft of the question- 
naire provided an opportunity for the respondents to 
make additions^ deletions, and changed. 
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2. The questionnaire (QI) was reviewed by a 
cpmmittee of experts in one or more of the following 
areas: vocational education, bilingual education, evalua- 
tion and/or statistics. The questionnaire ^ras revised 
following *the committee review. 

3. The revised questionnaire (QII)* was further 
reviewed by individuals knowledgeable in BVE to determine 
which items or area(s) — if any — were unclear. The 
questionnaire was revised as needed following the review,* 

4. The questionnaire (QUI) was pilot tested on 
a representative group outside the State of Florida, in 
order to prevent contamination of the limited identified 
population. This questionnaire was revised as needed 
following the pilot tesU. No relevant data were collected. 

5. The questionnaire (QIV) was administered to* 

j 

the BVE personnel who agreed to participate in the identi- 
fied programs in the State of Florida. The appropriate 
administrative personnel were contacted in order to obtain 
permission to 'collect data from program personnel. 
The information obtained from the analysis of the question- 
naire (QIV) identified the additional needs to BVPs as 

*i 

compared to those of regular VE programs. 
» 

The' BVE component of the Vocational Education 
Program Review for the State of Florida was developed in 
three parts td correspond to the Florida model. The 
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parrs of the 3VE component are: (a) self ^evaluation ; 

(b) on-site evaluation? and (c) post-evaluation conference. 

Tue component was designed to be incorporated into the 

existing program review format. Those standards and 

criteria tfhat wer identified in the first part were 

utilized in this portion of the study. 

Validity and Reliability of the - 
3VE Component 

The Bilingual Vocational program personnel in 

Florida who responded to the Questionnaire (QIV) established 

the validity of .the criteria and standards for the BVE' 

component to the Vocational Education Program Review for 

the Scatte of Florida. The lengfth of the questionnaire 

and tb<a complexity of the responses were handled in the 

following manner: 

1. • Vhe questionnaire (QIV) was administered on 
a one-co-one basis when feasible. 

2. Precompletion conferences were held with 
those *taff members with whom a one-to-cne coulcNrfot be 
conducted. 

3. Thirty-three percent of the total respondents 
were requested to begin the questionnaire at different 
points in order tc eliminate the problem of concurrent 
error that may ha^e occurred due to the length of the 
questionnaire. The remaining 6 7% of the participants 
began the questionnaire at the beginning. 
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The reliability of interpretation and content validity of 
the BVE component to the Vocational Program Review for the 
State of Florida was established during the field testing 
of the BVE component in the following way: 

1. The first schools from the list of BVFs in 
Florida were contacted and permission obtained to conduct 
the pilot test. Additional school administrators were 
contacted during the study, using the chaining methodology. 

2. Three participants, in each school, were 
strived for to provide for comparison of the standards 

/ 

and criteria found valid and the interpretation relia- 
bility of the instrument percei^d within each group. 
In the event that there were not three, the on-site 
visit between participant (s) and researcher observation 
at the sit^ was used for comparison. 

3. A letter explaining the procedures was mailed 
to the participating staff. The letter included the 
self-evaluation section of the BVE component. The par- 
ticipating personnel for the pilot test were requested 

to complete the form prior to the on-site program review. 

Analysis of *the Data 

Part I — The Questionnaire (QIV) Analysis . The 
data obtained from the questionnaire were analyzed to 
determine the respondents 1 beliefs in reference to the 
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additional needs standards and criteria necessary for 
effective BVPs within the State of Florida, as compared 
to the standards and criteria for regular VPs. 
Phase 1 — Program Requirements for BVPs 

Staff . The participants were requested to 
express their ^pinions as to the appropriate ratio of ,? 
students to staff in teaching effective BVE and tradi- 
tional VE programs in the State of Florida. An average 
of the responses received from the staff of each school 
participating was computed; the averages Obtained from 
thi£ computation were then used to obtain a statewide 
average. \ 

The data were used to determine the number of 
students per staff member that the respondent indicated 
w^uld be a minimum, in order to ensure, quality BVPs and 
VEPfc. The researcher used the data to determine if there 
was a need for additional staff in delivering a BVP as 
compared to a traditional. VP by comparing the number of 
students who could be effectively served by each staff 
member. An average was computed by school and for all 
programs . 

r 

Staff skills , curriculum components and materials . 
The requirements for additional staff skills, curriculum 
components, and materials for BVPs,as compared with 
traditional VPs were determined by the use of data from 
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the questionnaire. The response scale for this section of 
the questionnaire ranged from necessary to not necessary. 
A component or material was required in the delivery of 
quality BVPs, if a minimum of 60% of, the responses from the 
participants indicated that it was necessary. 

Facilities / equipment and supplies . The need for 
additional facilities, equipment, and supplies required for 
BVE, as compared to traditional VEPs, was determined by the 
use of an interval scale of less, the same, or more. The 
need for additional facilities, equipment, and supplies was 
considered to be necessary'by the participants for effective 
instruction of the LEP in the event that, a minimum of 60% of 
the responses were "more." Participants Were also asked to 
identify the specific skills, facilities, equipment, and/or 
supplies that were required, when they perceived a need for 
"more" or "less." 

V 

Part II — The Standards and Criteria Necessary for 
Effective BVPS 

The standards and criteria, which, when met, that 

would provide effective BVPs in the State of Florida were 

determined by three analyses. The first analysis determined 

the relevance of each standard to BVE, The participants 

responded on a four-point nominal scale of BVE, VE, both or 

none. A standard was considered necessary for effective 

BPs in the event that BVE or both was selected by a minimum 

of 60% of the respondents* For those standards identified 

as necessary for BVP or both, the criteria were then rated on 
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two scales • 

The first scale, a five-point interval scale o.f 
Strongly A^*ee (SAX, Agree (A), Undecided (U) , Disagree (D) , 
and Strongly Disagree (SD)f was used to determine the valid- 
ity of the criterion for fneeting the standard. In addition, 
the respondents who selected SA or A responded to a second 
"scale of "both" (VE or BVE programs) or "BVP M only. This 
scale was used fco determine if the respondents, who agreed 
that the criterion was necessary to meet the standard, be- 
lieved that it was relevant in meeting the/needs of all 
students or only the LEP students, 

A criterion was considered to be valid for the 

standard if a minimum of 60% of the responses selected SA 

and/or A. The criterion was considered relevant exclusively 

to BVE, if a minimum of 60% of the responses were BVE only, 

l 

The BVIPRC was reviewed to determine the consensus 
and/or discrepancies between responses to the self-evalua- 
tion form of the teachers- and the observations of the 
researcher. The consensus was required to determine the 
validity of the standards and criteria for BVPs and/or *VEP 
with LEP students/ and the reliability of the interpretation 
of the instrument was further examined through the use of 
personal interviews during the on-site visit and/or post- 
visitation conference. -Thus, the responses provided for the 
establishment of consensus and/or discrepancy on the inter- 
pretation of a specific item requested on the self- 

48 . 
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evaluation and Qn-site evaluation forms. 

The standards and their criteria^ identified and 
validated were included in the BVIPRC. Criteria tha+- were 
found to be invalid were included in zfre BVIPRC for the pur- 
pose of allowing school personnel to check off those 
procedures they were employing to meet the needs of LEP 
students. An example of these invalid criteria was the use 
of target language textbooks . 

The final analys/s of data for this study was the 
information obtained from the evaluation of the BVIPRC. The 
evaluation ofjthe component was conducted to determine if 
the data obtained from the BVIPRC would provide an indica- 
tion as to whether or not the programs were meeting the 
objectives of program review as specified by the state of 
Florida in its Five Year Mini Plan 1978-79, based on the 
State of Florida Five Year Plan. An objective was perceived 
as met when a minimum of 60% of the respondents agreed. In 
addition, the participants revalidated the standards and 
criteria as appropriate for the evaluation of BVPs and 
vocational programs with LEP students. The standards and 
criteria were perceived as valid if a minimum of 60% of the 
selected responses to the question were "Yes" using a "Yes" 
or "No" scale. 
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CHAPTER ■ IV 

RESULTS AND DISCUSSION 

In this chapter, tne researcher presents the findings 
of the study based on the statistical analysis of data 
obtained from the three parts of the study. The first part 
included the administering of the questionnaire designed to 
identify the additional needs of Bilingual Vocational Pro- 
grams (BVPs) , programs with Limited English Proficiency (LEP) 
students enrolled, as compared .to traditional Vocational 

at 

Programs (VP) , programs with English Speaking (ES) students 
enrolled, an4 to identify the standards and criteria, which, 
when met, would indicate that effective Bilingual Vocational 
Education (BVE) and/or VE for the LEP Students was being 
provided . * 

The second part of the study was the pilot testing 
of the Bilingual Vocational Instructional Program Review Com- 
ponent (BVIPRC) which contained the standards and criteria 
identified by the analysis of data obtained during the 
administration Of the questionnaire. The pilot test addi- 
tionally provided for the revalidation of the standards and 
criteria perceived by the initial respondents as necessary 

for effective BVPs. The BVIPRC design was based cn the 

! / 
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Florida Vocational Instructional Program Review process 
model that provided self-evaluation, and on-site review 
sections . 

The third segment of this study was the field 
testing of the revised BVIPRC and its evaluation. in 
addition, the population that participated in the study 
and \their educational institutions are shown in Tables 1 
and 2 . 

Table 1 shows the types of schools whose staff 
participated in this study and the types of programs m 
they employ ir the instruction of the LEP students 
enrolled. The schools included high schools, community r 
colleges, adult education programs, and vocational tech- 
nical centers. The requirements of these school programs 
included E£L instruction and minimum English competency 
attained by students prior tc admission +-o vocational class, 
to instruction mainly in the target language. 

The instructional personnel who participated in 
this study represented bilingual and monolingual 
administrators, bilingual and monolingual instructors in 
the areas of VE and ESL* Table 2 shows the distribution 
of participants by areas and languages spoken. A total 
of 69 BVE staff participated in the three part study, of 
whom 35 participated twice, responding to the questionnaire 
and pilot test of the BVIPRC. The remaining 34 
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Table 1 

4 

Types of Schools and Programs in Which 
Particioants Are Eito loved 
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Programs 



Levels 



High Community Adult Vocational 
School College Education Technical 



VE with ESL 

VE with bilingual 
instructor in at least, 
one target language 

VE in the target 
language ( Spanish ) 

VE (English only) 

ESL (prior -to VE 
admission) 



VE =» Vocational Education 

ESL » Enalish as a Second Language 



ERLC 
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Table 2 

Instructional Areas and Language (s) Spoken by the 
Instructors of the LEP Students Who Participated 

in This Study 



Are$ of instruction 



Language ( s ) spoken 
other than^ English 



Administrator (2)* 

Administrator ( 1 ) 

Adult Basic Education (2) 

Air Cpnditioning (8) 

Air Conditioning & Heating 

Comme r c i a 1 Ph o tQg r a ph y 

Apparel Manufacturing 

Appliance Repair 

Auto Mechanics (3) 

Auto Mechanics 

Blue Print Reading and Estimates 
Business Education and Accounting 
Checkef and Casher 
Child Care 

Clerical Occupations 

Clerical 

Clerical (4) 

Commercial Baking & Decorating 
Cosmetology (2) 

Drafting * 
Electric 'Motors 

English as a Second' Language^ (ESL) 



ESL (4) 
.ESL 



ESL (2) 
ESL (5) 
Furniture 



Upholstery ^(handicapped) 



Tumiture Upholstery 
Individualized Manpower Training 

I^abor^tory (IMT)--ESL (5) « 
IMT-ESL (2) 
IMT-ESL (2) 
IMT-ESL 



None 

Spanish 

Spanish 

Spanish 

None 

Spanish 

Spanish 

None 

None 

Spanish 

Spanish 

Spanish 

Spanish 

Spanish 

German , Japanese 

Spanish 

None 

Spanish , French 

Spanish 

None 

None 

Spanish , French , 
Italian, Portu- 
guese 
None 

Spanish , French 
Portuguese , 
Ita 1-ian 

Spanish , Stench 
Spanish ^ 
Spanish , Sign 
Language 
Spanish 

None 

Vietnamese 
French 

Greek , Spanish 



5'J 
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Table 2—Continued 



Area of instruction 


Language (s) 


spoken 




other than 


English 


Learning Management 


None 


4 


Sewing 


Spanish, 


Italian 


Sewing 


Spanish 




Truck and Bus 


None 




Typing (3) 


Spanish 




Welding & Metal Work 


None 





( ) * If more than one, instructor? administrator was 
described. 
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respondent? participated in the field testing and eval- 
uation of the BVIPRC. a 
♦ ' 9 

Part I Questionnaire Development , 



and Data Analysis 

The questionnaire was developed by the researcher 

# 

using information Obtained from the review of literature, 
interviews, and correspondence pertaining to vocational 
evaluation, educational evaluation, an ' BV evaluation. 
The questionnaire (QI) was designed ta determine the 
respondents 1 beliefs as to the additional needs of LEP 
students enrolled in VPs as opposed to those enrolled 
traditional VPs. The questionnaire was also designed to 
identify the participants 1 perceptions of the standards 
and criteria, which, when met, would provide for effec- 
tive vocational education for the LEP students enrolled. 

The initially developed questionnaire (QI) was 
reviewed by a panel of expert and by representatives from 
the State of Florida, Bureau of Vocational Research, 
Dissemination and Evaluation. Their suggestions were 
then' incorporated into the p -lot test version of the 
questionnaire (QII) . 

The panel of expert^ suggested revisions in the 
areas of wor^ clarification and format of the directions. 
For example, one suggestion was to use the word 
"effective," rather than "quality" to describe the types 
of programs desired. The divisions of the 



dirictiu.^ into three sections were also suggested to 
correspond with the requested three responses. 

Specific changes that wer£ made based on the 

i 

recommendations of the representatives from the Bureau 
of Vocational Research, Dissemination and Evaluation were: 
(a) removal of suggestion that union representatives be 
included in. the ^<*visory committee; ) removal of the 
words "should be" from the questions in which respondents 
were requested to express their beliefs as to the specific 
persons, materials, etc., t\at were required; !c ) rewording 
of the question with reference to the repair of tools and 
equipment to read, "If tools and equipment break, service 
iS available to repair them" ; (c ) the removal of the word 
"iob" when speaking of placement of students; and (e) the 
rewording of job placement statement to read "Equal aid 
for placement is provided for program leavers ar*d com- 
pleters . 

The revised questionnaire (QII) was pilot tested 

in New York City to prevent the contamination of the 

lifted identified population within the State of Florida. 

The participants in the pilot test were instructors and 

administrators in BVPs and VPs with LEP students enrolled. 

The respondents represented the areas of 3VE, ESL for 

1 

vocdcional students and monolingual vocational instructors 
with LEP students enrolled in their programs. 

/ 
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The pilot test of the questionnaire (QII) was 
conducted as a one-to-one with each respondent, when 
possible. In the event that a one-to-one between the 
researcher and the participant ' was not possible, a 
precompletion conference was held. Additionally, a* 
critique form (Appendix D ) was provided. The form 
gave respondents an opportunity , to express whether or 
not they believed that the questionnaire was properly 
structured with reference to cover sheet and directions 
and if the stand? ds and criteria would, if met, provide 
effective BVE or VE for LEP students. The respondents 
were also asked tc make any additional comments directly 
on the questionnaire as they reviewed it. 

* The responses of the pilot test participants 
showed: ( a ) 100% of the respondents believed the cover 
sheet was appropriate, (b* 100% of the Respondents believed 
the oral directions given by the -esearcher were appro- 
priate, and (c) 75% of, the respondents believed the written 
directions were appropriate. The 25% who did not believe 
the directions were appropriate suggested that they be 
made clearer, but no constructive suggestions were made. 
An objective was perceived as met when a minimum of 60% 
of the respondents selected "yes" on a yes or no scale. 

One hundred percent of the respondents believed 
the standards were appropriate for BVE or VE with LEP 
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students enrolled. However, 75% of the respondents 
believed the criteria were appropriate. A minimum of 60° 
agreement was necessary for these criteria to be deemed 
by the respondents. The suggested changes incor- 

■» 

porated into the questionnaire were as follows: (a) a 
section was developed for the specific identification of 
the additional needs for BVE or VE programs with LEP 
students for staff, staff skill, material equipment, 
supplies, facilities, and program components;, (b) the list 
of "^Tuggested members of the advisory committee was 
expanded to include community leaders and retired employees; 
(c) the word ''dominant" in reference to the language of the 
LEP, was changed to "target" language throughout the 
questionnaire; (d) the suggested areas for reviewing mater- 
ials for discrimination was increased by the area of handi- 
capped and religious groups were removed; (e) the types of 
students encouraged to encer the program were increased by 
"LEP 11 and "handicapped"; and (f) the sugaestion- of "reli- 
gious groups living in the area" was removed for tr>e field 
test version of the questionnaire. The revised questionnaire 
(QUI) was then administered to the identified vocational 
staff/support staff for BV? and VPs with LEP students 
enrolled. 

The first part of the revised questionnaire (QIV) 
was designed to determine the additional needs of LEP 
students enrolled in VP. The areas addressed 

58 . 
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by this portion of the questionnaire ^ere: staff require- 
ments , instructor skills, facilities, equipment , supplies, 
curriculum components and special materials. 
Additional Needs of Bilingual Vocational Programs 

The participants were requested to express their 
opinions as to the appropriate ratio of students to staff 
in teaching BVE and traditional VE programs in the State 
of Florida. An average of the responses was calculated 
for each school whose staff participated in the study. 
These averages were used to obtain a statewide average 
for each staff position identified. 

The comparison of the number of students, ESL 
and English Speaking (ES) , provided an indication to the 
additional staff necessary in the effective instruction of LEE 
students as compared to ES enrolled in VE programs. 
Table 3 shows the state average that was calculated from 
the responses of the participants in reference to the y 
number of LEP and ES students who are effectively served 
by each st^ff member* 

The responses of the participants indicated that 
nearly twice as many ES students as LEP students can be 
served by a monolingual instructor, the averages being 
15. 2 and 8,3 respectively. The respondents reported 
that the bilingual teacher could serve slightly more LEP 

" v,, ^';ats (X = 9 , 3 ) than the monolingual^ teacher , but also 

/ 

slightly fewer £S students (X = 14.2) m S 
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Table 3 

Ratio of Staff to Students Required in the Instruction of 
Limited English Proficiency Students as Compared. to English 
Speaking Students, 

1 ■ . — 

Staff Member ES LEP 



1. Vocational Instructor who speaks English 

oRly 15.2 8.* 

2. Vocational Instructor who speaks English 

and target language (s> ; 14.2 9.3 

2. Paraprof essional who speaks English 
/ only 15.2 12.4 

4. A Paraprof essional who speaks English 

and target language 14.0 12.2 

5. ESL Instructor 15.2 

6. Guidance Counselor who speaks English 

only 117.0 110.0 

7. Guidance Counselor who speaks English 

and target language(s) 118.5 102.5 

8. Occupational Specialist who speaks 

English only 83.0 32.3 

9. Occupational specialist who speaks 

English and target language 71.5 71.5 

10. Community volunteer who speaks English 

only * 11.5 10. 0 

11. CoT^unity volunteer who speaks English 

and targe*; lancuage(s) 1?.7 11.2 
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" The "support personnel , paraprof essionals , guidance 
counselors, etc., were also indicated as being able to 
effectively serve larger numbers of ES than LEP students. 
An example was the English speaking paraprof essional who 
was perceived as effectively serving an average of 15.2 
*ES students but only an average of 12.4 LEP students. 

The ESL instructor was reported as being able to 
effectively serve an average of 15.2 LEP students. The 
respondents believed tnat there is a need for an addi- 
tional vocational instructor and ESL instructor to serve 
the same number of LEP as ES students. 

Staff Requirements, Curriculum Components and Materials 

The data that provided for the identification of 
the additional needs tot staff skills, curriculum com- 
ponents, and materials for VE programs v:ith LEP students 
enrolled were obtained from the questionnaire (QUI) . 
The questions were designed to identify the^ additional needs 
of the VE programs with LEP students on a three point 

response scale of necessary, not necessary, and undecided . 
I 

A skill, component, material, equipment or supply was con- 
sidered to be required in the delivery of effective BVPs, 
if- a mnir!<um cf 60% of the responsas werfe "necessary." The 
60% minimum response used throughout this study provided for 
a' 10% error factor and a- 50% more working majority as to the 
validity of the identified factors. The percentage was 
calculated on the number of responses to each question and 
not the total number of participants, because participants 

61 
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Table 4 



»Li i tot i-f I , j j , f j i |, ,«i u *«.iivy atuiJents 



Lultuiil 

smii. 

H.« «Vc fl«ff 
■ f**- Jk j/kl ur, ' 
<i«.| *l J.'VJ t It* 

Tft# JiVt „t*f t 



t>0.0 



100 



l Jon 



6 _ 7 

* f i 



* «6.9 10 81 3 

1 11-1 1 It, 7 

H 8« * 10 6i i 

1 11.1 

I 16 6 



noc .ur. if t hm , kln w „ „ec«...r y for in.tructor of LLP .tud.nt. 



a en ti jj 

1 li 1 s 



to. J 
77.5 
10-0 
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Table 5 



Cultural Skill* Neteaaaiy tot tha inaWuclton of Hailed fcngltal. 
Piofictaucy *tudet-La in tlur id* 



Cultural 
Skill* 



2*-* la 



Tl»a »V* «t«ff la 
•wnalttvs to atu- 
d«ii»a" cultural 
•ttltu4«a to 
•tarda laarnirw}. 

Tfca avt ataff la 
•wnaltftva to atu- 
atonta cultural 

•octal atruc- 
tura tftctv-ttn** 
f*«lty 4 author- 
ity llyuraa. 

Tl.a *v* ataff U 
sanaitiv* to cul- 
tural tti<]M 
a a am ist«<| with 
auaa vutJi 01 
• *(><««• h.na 

areta 



w 

WW 

u 



1 ii.O 



0 



1U0 



tducatlcoal Pro^ra** 
f "l f 

2 100 X 



100 



I » ft truancy that raa^naaa wee a »«lait«J within tha achool 
it * Tha total nutui of ttaaa tha rrajiootfa waa aaJtctid t>y all at. 



hoola 



H - Tha a* 111 la necarfaaiy fo< %u< t,, a r lu ^oi of Malted EnoJUh Proficiency studar.ta (Ul>) 
HN m Thi aklll la not Mc«c»iJ^ f<-i tl.a toaUuctore of LEF atudai.ta 
U » Tha raaoomJai.t waa not aula If th« aklil waa naitaaaty foi timtiuc^oi of Iap student* 



t % 

9 100 



9 
I 

J 

8 Cfl 9 7 
4 

1 11 1 1 

6 66./ 11 

1 11.1 1 

2 22. 2 



?5.0 
I.) 
18.7 
58.) 

i J 

8. 3 

9i.; 

8. 3 



8 

22 2 



7 7/. 8 
2 22. 2 



77. a 
11.1 
11.1 



Total 
CF " t - 

u 

4 

2 
JO 

i 

2 



J2 
4 
4 
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were requested to leave tjank those responses that they wer 
not able to answer kncwledgeabiy . The questionnaires were 
administered one-to-one when possible and reviewed by the 
researcher when this was not possible. This procedure n 
reduced and' possibly eliminated the massing data. 
Instructor Skills 

The data obtained from the responses were analyzed 
using a 60% minimum response to identify a skill as being 
perceived as necessary by the ^participants . Table 4 
shows that it was considered advantageous by the partici- 
pants for the instructor of LEP students to speak, under- 
stand; read, and write the target language. Table 5 
shows that the instructor's understanding of the students 1 
culture in reference to attitudes towards learning (85.0) , 
social structure {75.0), and specific word stigma (80. 0) , 
was necessary. 

Facilities, Equipment, and Supplies 

The date obtained from the responses were analyzed 
using the 60% minimum response to identify whether the 
respondents perceived a need for additional facilities, 
equipment, and supplies. As shown in Table 6, the facili- 
ties, equipment, and supplies necessary for the instruction 
of LEP students, as compared to those necessary for the ES 
students, were believed tc be the same by a minimum of 70 3 
of those who responded. 
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Table 6 

Instruction of Lb? i»twd*nta 



Vaullitiaa 
iui*»|l«a 



Educational Wo>ji**« 

_____ _ 

t • < » 



Tot* I 
C» t 



N 


1 iO. 0 














2 


2i.2 






i 


I.J 


L 
















1 


11.1 






2 


2.7 




i _o o 


4 


100 i loo 


2 


too 


1 100 » 


lou 


6 


66.* 


9 


luo 


J2 


«6 0 


M 


1 0 


4 
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1 
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2 


22.2 








11. i 






2 


*>Q.O 






1 


12.5 
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1 t>u 0 
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The following are exairtples of statements made by 

4 
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the 4 respondents who believed th^re was a need for additional 
facilities (8.3%), equipment (14.3%), and supplies (25.0%). 

1. Additipnal facilities for small groups to be 

served. 

2. Additional equipment for ESL instruction. 

3. Additional supplies (paper, workbooks, etc.) for 
the ESL component. 

Curriculum Components ' 

The components necessary in th^, instruction of 
LEP students enrolled in vocational education programs 

k r 

and not for ES are shown in Table 7. A component for 
English Language skills was considered necessary by 100% 
of the participants-. The need for cultural understanding 
was considered necessary by 87% of those who responded to 
the question. 

Special Materials for the. Instruction 
of LEP Students 

Table 8 shows that the respondents perceived that 

the instruction of LEP students requires ESL materials 

(84.6%), bilingual audiovisual materials for the occupational 

area k&t*. £%) . In addition, the table shows that the respon- 

( ' 1 

dents\did not perceive a need for bilingual (55.0%) or 
target language textbooks (44.7%). The need for bilingual 
or target 1 nauage textbooks was then analyzed in reference 
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Table 7 

Additional CucMcoIum CtMtttoncnta N«c««««iy for th« Instruction ot 
LCP Voalloi.al tducallou Slu4«nl« 



Cut I t<-ulu» 



m^nt o^^xitnt (•) 



100 



i J 



100 



8 



cY " % 



100 



2. C ut curat undai - 
. «t *n41rxj co* 
pontnt U) 



100 



) it.i 
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1 16.7 
1 t. 3 
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to the types of programs che participants represented : 

SVE and SSL. Table 9 shows that 61.31 of the BVZ staJf con- 

sidered it necessary to have bilingual textbooks, whereas 

33.3% of t*ie ESL staff considered it necessary to hava thfem. 

The target* language textbook were not rated as being 

necessary by the ESL (10%) of BVE '51%) groups. 

Summary of the Additional 
Needs or BVPs 

Responses to the first section of the questionnaire 
referred to the additional needs of BVP in reference to 
staff, staff skills, facilities, equipment, supplies, 
and curriculum components. The additional needs of the 
1£P students enrolled in VPs were perceived by the partici- 
pants to include: 

1. Language skills (for both student and instruc- 
tor) 

2. Cultural understanding (by both students and 
instructors) 

3. A smaller ratio of students to staff 

Standards and Criteria for the 
Objectives of Vocational Pro -" 
grams with LEP Students 

As shown in Table 10, standards and their criteria 

concerning program objectives and materials were considered 

to be necessary by the respondents. The results of tne 

data analysis are presented in two sets, the requirement 

that subject rratter and objectives meet the specifications 

fit) 

*< 



Te '•books 


Table 9- 
Required for the 


LEP Students 










Education 


Programs 






ESL 




BV 


Materials 


Scale 


CF % 




f> 


Bilingual Textbooks 


N 


3 33.3 


19 


61.3 




NN 
U 


6 66.7 


11 
1 


35.5 
3.3 


Target Language 
Textbooks 


N 
NN 


2 * 10.0 
8 80.0 


15 
13 


51.0 
44.0 




U 




1 


3.4 



Code: N= Necessary, NN= Not Necessary, U= Undecided, 
CF= the total number of times that answer was selected by 



all the respondents, %= the percentage of the times the 
answer was selected by all the respondents, ESL- English 
as a Second Language, BV= Bilingual Vocational Education 
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Table 10 % 



Program Objective Standard 'and CrJtort* 



BVE 



'Scale 



VE 



BOTH 



Standard : 

Program objectives are consistent with 
Vocational Education Program Course 
Standcirds-1980 for the State of Florida 



CF 



CF 



10 27.0 



5.4 



Scale 1 



CF % 
23 62.2 



SA 



U 



SD 



Criteria: 

A. The subject matter in this 
program corresponds to the 
program description specified 
in the Vocational Education 
Program Course Standards for 
the State of Florida 

B. ' Objectives have been written 

to cover the subject matter 
in the progiam 



CF % CF % CF % CF % CF % 



BOTH 
CF % 



16 55.1 10 34.5 3 10.3 0 0.0 0 U.O 22 95.7 



9 37.5 12 50.0 2 8.3 1 4.2 0 0.0 15 93.8 



Scale 



BVE 



VE 



DOTH 



Standard : 

Program objectives are consistent with the 
BVt; standards as specified by the major 
funding source (federal, state, community, 
other) 
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CF 1 CF % CF % 



5 13.9 5 13.9 25 69.4 



Table 10 — Continued 



Scale 2 



SA 



BOTH 



BVE 



Criteria: * 
A. The* subject matter in this 
program corresponds to the 
program description speci- 
fied by the major funding 
source 

b. Objectives have been written 
to cover the subject matter 
in the program 



CF % CF % CF % CF % CF % CF % cF % 



9 32.1 19 b7.9 0 0.0 0 0.0 0 0.0 24 96.0 4 4.0 



11 37.9 17 58.6 1 3.5 0 0.0 0 0.0 22 84.7 4 15.3 



Scale: 

*\ 

BVE * The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE = The standard is appropriate only for students enrolled in traditional Vocational Education 

(the language of communication is English only) 
None= The standard is not necessary for an effective BVE and/or VE programs 
Both- The identified standard is equally relevant to BVE and VE programs 

L'A * Strongly Agree that the criterion described would have considerable impact in meeting the 

standard in an effective BVE program 
A = Agree that the criterion described would have a modoratf- impact in meeting t stcinddiri 

in an effective BVE program 
U = Undecided that the criterion described would have any impact in mooting the standard 

in an effective BVE program 
D t Disagree that the criterion described would have any impact m mooting the uUmiurJ 

in an effective BVE program 
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Table 10 



Scale — Continued 



SD 



= Strongly ^Disagree that the criteiion described would have any impact in meeting the 

standard in an effective BVE program 
= The total number of times that response was selected by all the respondents 

= Percentage of the total time that response was selected by those* who responded to the questionnaire 
m The total number of times thp 



Note: The percentage is calculated according to the number of responses to each question and not the total 
number of participants. 
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of jzhe sponsoring agency in the State of Florida, and the 
requirement that the program meets the requirements regarding 
the subject matter and objectives for the specifications of 
other funding sources. The first standard, "Program 
objectives are consistent with VEP Course Standards-1981 for 
the State of Florida" was found approoriate for both (BVE 

4* 

and VE) by 62.2% of the respondents, and for BVE only by 

27.0% of the respondents: a total of 89.2% for BVE plus 

"both," VE only was believed appropriate by 5.4%. The^ 

respondents reported that it was necessary for the standard 

to be met. in an effective BVE and VE program in the'Stat^ 

of Florida. ^ 

The criteria for the above standard were (a) the 

subject matter in this program corresponds to the program 
» 

description specified in the VEP Course Standards for the 
State of Florida, and (b) objectives have been written to 
cover the subject natter in the program. These criteria 
were four.:, relevant (SA plus A) by 89.6% and 37.5% 
respectively, of the respondents. 

The second standard for program objectives that 
referred to major funding other than stane was perceived 
as relevant zo both (BVE and VE) by 69.4% of the responses 
and only for BVE by 13.9% of the responses. Thus, agree- 
ment for the second standard for BVE plus both was 33.3% 
of the total responses. 

The criteria for the second standard were: 
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6 

(a) the subject matter in this program corresponds to 

the program description specified -by the major funding 

source, ? <d (b) objectives have been written to cover the \ 

subject matter in the program. These were found relevant 

to the standard by 100% for criteria ."a" ancj'96.6% for 

•criteria ,f b" . 

In addition, 'both program objective standards and 

their criteria were found relevant to both (BVE and VE) 

programs. Table 10 shows the analysis of the ratings 

given by the participants to the program objective 

standards and their respective criteria. 

Instructional Content Standards 
and Criteria 

The analysi s of data for the standard and criteria 
for instructional content are contained in Table 11. ( 
The first standard "Courses or units of instruction in 
this program are based on defined or measurable compe- 
tencies required for employment," was found relevant to 
"both" by 65.0% of the respondents, and for BVE by 22% 
of the respondents. The overall determination of this 
standard by the participants wis that the standard was 
appropriate for ''both" (BVE and VE) . 

Tw<3 of the three criteria for the above standard 

were: (a) the program provides students with the needed 

knowledge, skill and attitudes required for employment, 

and (b) the exit competencies of the student are compatible 

x 
$ 
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Table 11 

Instructional Content Standard and Criteria 



Scale 



BVBf 



VE 



BOTH 



CF 



CF 



CF 



NONE 
CF 



Standard: 

Courses of units of instruction in this program 
are based on defined or measurable competencies 
required for employment 



9. 22.5 



5 12.5 



26 



65.0 0 0.0 



Criteria: 

A. The program provides students 
with > the needed knowledge, 
skill and attutides required 
for employment 

B. The exit competencies of the 
stuaent are compatible with 
current employment practices 
in the field of training 

C. The methods/sources that are 
used in the development of 
course or units of instruction 
are: (rate all choices)' 

(1) Task analysis of 
occupation 

(2) Available curriculum 
guides 

(J) Textbooks 

(4) Learrning Task analyses 









Scale 1 


; * Scale 2 


SA 




A 


U 


D ' SD BbTH BVE 


CF % 


CF 


% 


CF % 


CF 1 % CF % CF % CF % 










i 


17 51.5 


16 


48.5' 


0 0.0 


i 

0 0.0 0 0.0 29 90.6 3 .9.4 


12 37.5 


17 


53.1 


1 3.1 


/ 

2 6.3 0 * 0.0 25 93.0 2 7.0 



10 


32.3 


18 


58.1 


2 


6.5 


1 


3.2 


0 


0.0 


25 


86.2 


4 


13.8 


10 


31.3 


17 


53.1 


2 


6.2 


2 


6.3 


1 


3.1 


20 


&0.0 


5 


20.0 


6 


18.8 


22 


68.8 


3 


9.8 




3.1 


0 


0.0 


21 


80.8 


5 


19. 2a> 


7 


22.6 


18 


58.1 


6 


19.4 


0.0 


0 


0.0 


18 


85.7 


3 


14.3* 



7!) 
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Table 11 — Continued 



Scale t 



"Scale 2 



SA 



D 



SD 



BOTH 



BVE 



CF 



CF 



% CF 



CF 



% CF 



(5) Subject matter expert » 
interviews / 

(6) Subject matter expOTt % * 
committees 

(7) Observation of\ workers* in 
occupational area 

(8) Special needs of students 
1[9) Special characteristics - 

of students / 4 



% ' CF 



7 22.6 20 64.5 . 3 9.7 



7 22.6 12 38.7 10 32.3 



1 3.2 0 0.0 23 88.5 

2 6.5 0 0.0 16 94.1 



.12 38 f .7 11 35.5. 6 19.4 2 '6.5 0 ,0-(/ 20 90.9 
15 "48.4 12 38.7 4* 12-9 0 f 0.0 0 <T.O 25 92.6 

14 43^ 9 28.1 9 28.1 0 0.0 0 0.0 17 01.0 



5.9 



7.4 1 



19.1 



Scale: 



BVE - The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE ~* The standard is appropriate only for students entplled in traditional Vocational Education 

(the language of communication • is English only) 
Both » The identified standard is equally relevant to BVE and VE programs 
None ■ The standard is not necessary for an effective BVE and/or VE program 

SA r Strongly Agree that the criterion described would have considerable impact in meeting the 

standard in an effective BVE program 
A * Agree that the criterion described would have a m<#ivrat*> impact in meeting the- standard in 

an effective BVE program 9 * 

11 « Undecided that the criterion described would \ave any impact in meeting the standard 

in an effective BVE program , 
*b ■ Disagree that the criterion described would have any impact in meeting the istandard 

in an effective BVE program 
SD ■ Strongly Disagree that the criterion described would have any impact in mooting the 

standard in an effective BVE program 
CF * The total number of times that response was selected by 'all the respondents 
% - Percentage of the totaJ time that response was selected by those who responded to the question 
naire fc K a 

f * The total number of times the response was selected within the school ^ 
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Table 11 



Note: The percentage is calculated according to the number of responses to 
each question and not the total number of participants. 
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witn current employment practices in the field cf trainmQ, 
Both criteria were found to be relevant for meeting the . 
standard, 100% and 90.6% j espectively . by the respondents. 
"Relevant" was defined hex^ as a criterion ^whose respondents 
selected SA plus A a minimum of 60% of the time,. 

The additional criterion "The methods/sources that 
are used in the development of ccurse or units of 
instruction are M was founa relevant for the standard by 
the participants as follows: (a) analysis of occupation 
(90.4%)% (b) available curriculum guides (84.3%), (d) text- 
books (8*/. 4%), (d) learning task analysis ' (80 . 7% ) , (e) sub- 
ject matter interviews (87.1%), (f) subject matter expert 
committees (61.3%), (g) observation of workers in occupa- 
tional area (74.2%), (h) special* needs of students (87.1%), 
and'd) special characteristics of students (71.9%). The 
above stated standard and its criteria were also ^ound perti- 
nent to "both" (BVE and VE) programs by the respondents. 
The responses indicated that there is a need for additional 
resources when there are LEP students enrolled in VEPs. 

Part II The Standards and Criteria 
Necessary for Effective BVPs 

The second part cf the questionnaire was concerned 

with the identification of standards and their criteria tr-^S 

.^nich, when net, would indicate that the program had the* 

proper components for effective VE of the LEP students 

enrolled. 
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For this segment of the study the researcher 
utilized the standards and criteria included in the P orida 
Vocational Education Instructional Program Review (VEIPR) 
and those new ones identified by th^ review of literature, 
interviews, and correspondence. Three analyses were used 
in the identification of the standards and criteria neces- 
sary for effective BVPs. The standards were analyzed 
b ad on <* nominal scale of BVE, VE, both, or none data 
to determine the relevance of each standard to BVE. A 
standard was considered to be necessary for effective BVPs 
in the event €hat ^"BVE" and/or "both" was selected by a 
minimum of 60% of the respondents to the question. 

Each criterion was rated on two scales, the first, 
a five point interval sc^le of Strongly Agree (SA) , 
Agree (A) , Undecided (U) , Disagree (D) , and Strongly 
Disagree (SD) , was used to determine che validity cf the 
criterion for meeting the standard. The second scale 
was "Both" (VE and BVE programs) or "BV?" only. The latter 
scale was used to determine if the respondents who agree 
that the criterio^ was necessary to meet the standard 
believed that it was relevant in ireeting the needs of all 
students or only the LEF students, 

Th3 criterion was considered tz be valid for the 
standard if a lainimum of 60% of the responses were SA and/or 
A. For a criterion to be considered relevant exclusively * 
to BVE, * irtinimum of 60,% of the responses had to be BVE only 

i 



The standards and^their criteria were organized 
by program components such as program objectives, 
instructional content, advisory committee, and staff quali^ 
fications. Each standard and its criteria were examined 
separately to determine the participant's perception as to 
the relevancy of each standard to BVP and each criterion 
to the standard and BVE. 

The VEIPR for the State of Florida required that 
the individual program objective be consistent with 
Vocational Education Program Course Standards for the 
State of Florida for the purpose of funding and/or 
refunding. The 1976 VEA and other federal . funding sources 
al-so require program obj ectives\ to be consistent with the 
objectives of the sponsoring agency. The standards and 
criteria for program objectives in this study concurred 
with the requirements to the major funding sources of 
VEPs in Florida. 

Table 12 shows the analysis cf data for the * 
standard and criteria for instructional content reference 
to the "foork Experience'' program. During this study, 
no vfork experience program^ were identified with which to ' 
validate the /findings . The participants 1 responses to, the 
needs of the ' ,f Wo**k Experience" programs are presented, 
but it was stated by a majority of the respondents that they 
were not familiar with "Work Experience' 1 programs. The 
standard and criteria validated by the participants were nut 



Table 12 

Instructional Content Standard and Criteria "Work Experience" 



Scale 



BVE 



VE 



CF 



CF 



BOTH 
CF 



NONE 
CF 



The "Work Experience 0 program is ^ased 
on identified student needs 



Criteria: 

A. The "Work Expedience " program 
was established due to high 
potential dropout rates of: * 

(1) All students 

(2) Limited English speaking 
students 

B. The program is continued b^tsed 
on current dropout rates of; 
(1) All' students 

C. The dropout ratej are sub- 
stantiated by: (rate all) 

(1) School records 

(2) Student survfc 




D. Dropout r sites are recorded by 
dominant language of the 
student 



8.11 



5.4 30 81.1 2 5.4 



Scale 1 



Scale 2 



SA 



CF % 



SD 



BOTH 



BVE 



CF 



% CF 



% CF 



CF 



% CF 



% CF 



6 21.4 36 57.1 



7.1 3 10.7 



5 17.6 8 28.6 9 32.1 4 L4.3 



3.6 23 91.3 



4 14. 3 11 39.3 10 35.71 3 10.7 0 0.0 16 88.9 



4 16.0 16 64.0 3 12.0 2 8.0 0 0.0 15 93.8 



Scale*; £ee next r>a*je [) 



8.7 



7.1 9 81.8 2 lti.2 



11.1 



9 32.1 14 50.0 4 14.3 1 3.6 0 0.0 19 86.6 3 13.0 



6.1 



7.7 7 26.9 9 34.6 5 19.2 3 11.5 5 5j.d 4 44.4 
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Table 12 Scale 
UVE 
VE 



« Se'sU^ar'd S ST**-? ^ I" eni ° U ^ in Bili ^ ual Vbcation.1 Education 
Tt^e ll^lL r PP dte .° nly < or stud «nts enrolled in traditional Vocational Education 
(the language of communication is English only) _ _ J^cacion 

Both - The identified standard is equally relevant to BVE and VE programs 

- r^ri n ^^^ ta. impact in nieeting 

" iTS e? a L;L C BV E C ;,rt n r r Cribed ""*" * ^ e " te ^ 4 " ^ «» standard 

** 2 fc .?f i S,^ h l^ i0n d6SCribed W ° Uld haVe "* ^ — ing the standard in 

■ i?rs,-t^^^:: m ion described wouid ~ have any impact th * * 

* £325 Sir 2.2:^^: described would have — - ~«- - 

» The total number of times that response was selected by all the respondents 

* l^ToZiti t0tdl that Sele " ed »* ««• whoTes^nded to the 
» TJ.? total number ,f times the response was selected within the school 
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incorporated into the state model because validation -fey — 
representatives from the area of instruction was not pos- 
sible. 

The standard "the 'Work Experience 1 program is based 
on identified student needs" was found appropriate for 
"bcth" by 81.1% of the respondents' to the question. The 
criterion "The 'Work Experience' program was established 
to hiqh potential dropout rates^: - (a) all students, and 
(b) LEP students were found relevant by 78.5% and 46.2% 
♦respectively of * the respondents . Th ls analysis showed that 
the respondents believe that LEP students should be 
included with the main group and not identified separately. 

The criterion "The program is continued based on 
current dropout rates of all students," *^as not found 
relevant to 3VE Work Experience or Rork Experience in. 
general. The responses from thfe participants indicated 
that 53.6% believed that the criterion was relevant for 
tne standard. The analyses of data from both groups 
together furtner showed the respondent '^belief that the 
criterion "The dropout rates are substantiated by: 

i 

(a) school records , and (b) student surveys" was found 
relevant by 82.1% and 80.0% respectively. This criterion 
was additionally found pertinent to "both" BVE Work 
Experience and traditional Work Experience programs, with 
a response of- 86.6% (Part a) and 93.8% (Part b) . 



The final criterion ^Dropout~rates are* recorded by 
dominant language of the student" was not found relevant for 
-the standard to^be me tT with a response ~bf 34.61 from the 
participants. The criterion was also not found pertinent 
for "both" or "IJVJV only "Work Experience" programs wi,th a 
response of 55.6% and 44.4% respectively. 
Advisory Committee Standard and Criteria 

Table 13 shows the analysis of the respondents' 
beliefs as to the composition and functions of an advisory 
committee for VE Programs with LEP students and/or FS 
students enrolled. The standard for the advisory committee, 
"The program is supported by an organized and active 
advisory commiteee," was identified as appropriate for 
"both" by 77.5% of the respondents. 

^The first criterion for the standard was divided 
into four components. The~criterion and its components 
were "The advisory committees that may serve this program 
are: (a) one countywide committee for all vocational pro- 
grams, (b) a specific countywide committee for an occupa- , 
tional arjea, (c) 3chool/college-wide advisory committee for 
the si^E5t£j.c program only. The criterion was identified as 
relevant for meeting the standard, in the event that a 
minimum of 60 of the respondents selected SA plus A. 

The analysis of data for the first criterion implied 
that the respondents did not believe that a county-wide 
committee for all vocational programs (44.3%) and a school/ 



Table 13 

Advisory Committee Standard and Criteria 



Scale 



BVE 



VE 



BOTH 



Standard : 

The program is supported by an organized 
and active advisory committee 



CF 



CF 



CF 



NONE 
CF 



Criteria : 

A. The advisory committees that 
may serve this program are: 

(1) One countywide committee 
for all vocational pro- 
grams 

(2) A specii ic coiintywide 
committee for an occu- 
pational area 

(3) School /col lege -wide com- 
mittee for all VPs 

(4) An advisory committee for 
the specific program only 

B. The members of the advisory 
committee should include 
representation from the 
following* areas: 

(1) Employers 

(2) Supervisors and managers 

(3) Employees 



0 

Scale^ 1~ 



0.0 



4 10.0 



31 77.5 5 12. 5 



SA 



U 



SD 



BOTH 



BVE 



CF 



CF 



CF 



% 



cr 



OF 



CF 



CF 



10 32.3 4 12.9 3 

7 21.1 18 62.1' 1 

2 6.9 11 37.9 1 

5 14 Sl.ii 2 



9.7 11 35.5 



3.5 



*.7 



3.5 10 34.5 
7 . b 3 6.7 



3 9.7 11 91.7 

1 3.5 23 100.0 
5 17.2 12 100.0 

2 4.4 20 95.2 



% 



8.3 

u.u , 

0.0 

4.8 



14 


40 


7 


K, 


53. 3 


0 


0.0 


0 


0.0 


0 


o'.o 


27 


100.0 


0 


OAr 


11 


36, 


7 


18 


00.0 


0 


0.0 


0 


0.0 


1 


3.3 


21 


100.0 


0 


0.0 


8 


26 


7 


19 


C3.3 


3 


10.0 


0 


0.0 


0 


CO 


26 


100.0 


0 


O.lUi 
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# 
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erJc 



c. 
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Table 13 — Continued 



Scale 1 



Scale T~ 



4 


SA 




A 




U 




D 




SD 


. BOTH 


BVE 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


(4) Former students 


t 6 


20. 7 


16 


55.2 


6 


20. 7 


11 


3 5 


ft 


n n 




i no a 


A 


W .u 


(5) Present students 


1 


3.7 


15 


55.6 


1 


" 3.7 


9 


33.3 


1 


3. 7 


1 / 


i nn a 


a 


A A 


(6) Parents (high school level) 


2 


6.9 


18 


.62.1 


6 


20.7 


3 


10. 3 


o 




1 Q 


i nn a 


u 


i I A 


(7) Accreditation,, licensing, 






























and certification board 






























members 


a 


26.7 


13 


43.3 


8 


26.7 


1 


3.3 


0 


0.0 


2b 


9b. > 


1 


fo.3 


(8) Community leaders 


6 


20.7 


17 


58.6 


4 


13.8 


2 


6.9 


0 


0.0 


15 


93.7 


0 


0.0 


(9) Retired employees 


2 


6.5 


11 


5.5 


n 


5.5 


7 


. 22.5 


0 


0.0 


10 


100.0 


0 


0.0 


The membership of the advisory 






























committee is representative of: 






























(rate all) 








» 






















(1) Males 


14 


46 7 


12 


JO (\ 

H \J ■ 'J 




inn 


i 

A 


j • j 


n 
u 


a a 




i nn a 


A 

u 


( \ A 


(2) Females ** 


± j 


j ■ j 


12 


40.0 


3 


10.0 


2 


6.7 


o 


0.0 


2b 


i / \r\ a 


A 


A A 


(3) Ethnic groups living in 






























the a^ea 


1 A 




10 


33.3 


i 


3. 3 


4 


13.3 


1 


3 . 3 




\) b . M 


t 


4 . 2 


(4) Races, living in the area 
* 


12 


41 . 4 


12 


41.4 


2 


6.9 


3 


10, 3 




n n 




1 MA c\ 


i \ 
U 


f i A 


The functions of the advisory 






























committee are: (rate all) , 






























(1) identifying employment 






























opportunities for students 


8 


25.8 


23 


74.2 


0 


0.0 


0 


0.0 


0 


0.0 


31 


100.0 


LI 


0.0 


(2) Arranging for student use of 






























community resources 


5 


16.7 


23 


76.7 


2 


6.7 


0 


0.0 


0 


0.0 


28 


100.0 


0 


0.0 


(3) Kecornnkmding equipment and 






























tools for the program 


9 


29.0 


15 


48.4 


4 


12.9 


2 


6.4 


0 


0.0 


24 


100.0 


0 


o.o 


(4) Identifying cooperative work 




r 


























sites tot the students 


9 


30. 0 


1 b 


bO.O 


4 


13.3 


2 


6.7 


0 


0.0 


20 


100.0 


0 


o.o 


(5) bValuatirig che program 


0 


26.7 


19 


63.3 


2 


6.7 


1 


3.3 


.0 


0.0 


25 


100.0 


0 


0.0 
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* Table 13 — Continued 



(6) Identifying essential 
competencies for 
entering occupation 

(7) Assisting in cultural 
understanding 

(8) Providing and/or iden- 
tifying bilingual per- 
sonnel to assist in the 
cjassroom when needed 



SA 



Scale 1 
U 



Scale 2 



SO 



BOTH 



BVK 



CF % CF % CF % CF % CF % -CF % CF 



11 37.9 13 44. B 4 13.8 1 3.5 * 0 0.0 24'100.0 0 0.0 
9 32.1*16 57. r 3 10.7 0 0.0 0 0.0 26 92.9 .2 7.1 



6 20.7 15 51.7 3 10.3 3 ID. 3 2 6.9 18' 85.7 . 3 14.3 



VE 

Both 
None 
SA 



U 
D 

sp 

CF 
% 



enrolled in^Bilingual* Vocational Education 
trolled in traditional Vocational education 



BVE and VC programs 
BVfe end /or VE program 



Scale: 

BVE ■** The standard is appropriate only for students 

* The standard is appropriate only for studen* 
(the language of communication is English c 
The identified standard is equally relevant 
The standard is not necessary for an effectiv 

= Strongly Agree that t^e criterion described would have considerable impact in meeting the 

standard in an effective BVE program * fc ( 

= Agree that the criterion described would have a moderate impact in meeting tho utandaid in 
an effective BVE program % & 

* undecided that the criterion described would have any impact "in meeting the standaid in an 
effective BVE program 

* Disagree that the criterion described would have* any impact in meeting the standard in an 
effective BVE program 

* Strongly Disagree that the criterion described would have any impact-in meeting thq 
standard in an effective BVE program ' * 4 •* 

■ The total number of times that response was selected by all the respondents & 
« Percentage of the total time that response was selected by those who responded to the 
questionnaire 

« The total number of times the response was selbcted within the school 
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^ g 

college-wide advisory committee for all pr^g^ams (44,8%) was - 
relevant to the standard. » 

The additional analysTs of the' data for the first 
criterion showed' that "a specific county-wide committee » 
for an occupational area" and "an advisory committee for K 
the specific program onlv" were found relevant to th£ ' * 

* <. ) • • 

standard by 86. 2% and 73.0^ of the respondents. 

The members of the advis committee wer.e identified 
by the participants *as relevant f (a) employers (100%) , 

(b) supervisors and n^nagers (96..**,., ,(c) employees f 90.-0%) , 
(d) former students^ (75. 9%) , (a) parents (69.0%), (f)-accre- , 
ditation, licensing &nd certification board members (7J.0%), 
and (g) community leaders (79.3%). The respondents did not 
believe that the membership of the advisory committee should 
include (a) present students (59.3%.) and retired employees 
(43.3%). . • ^ " ( 

The third criterion "The membership of the advisory 
committee" is representative of (a) males, (b) females, 

(c) ethnic "gtpups living in the area, and (d) races living 
in the area were all found relevant to the standard by a 
minimum of 80% of the respondents. Additionally each of the m 
components of the criterion was found relevant to # "both" by 

a minimum of 95% 6f the respondents. 

The functions of the advisory committee wefe 
identified by the respondents to be as 'follows: (a) identi- 
fying employment . opportunities for students (IGJ.%) , 

3$ 
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(b) .arranging for students 1 use of community resources 

, (93.4%) , fc) recommending equipment and tools for the r 

^program (77.4?)', (d> identifying cooperative work sites for 

the 'students (80%)*, '(e) evaluating the program (90%), 

(f^ identifying °essential- competencies for entering occupa- . 

tion (82*.8%), (3)'* assisting in cultural understanding (89.3%) 

and (g) providing, and/or identifying bilingual personnel to 

assist in the classroom when needed (72.4%). The functions 

of the advisory Committee were additionally identified to 

* * 

be pertinent to "both" by more than 85% of the responses for 
each ^component of the 'criterion identified above. 
Staff Qualification Standard 

and Criteria " # 

The standard "The program is staffed by qualified 
personnel" was identified as appropriate bj{ 92.3% of the 
g respondents as, shown in Table 14. „ The criteria necessary to 
meet 'the standard for effective BVPs were identified by the 
participant's as follows:" a program staffed by qualified 
teachers/instructional* personnel in the following areas; 
1. VocationaVkducation (97.3%) 
2,. Vocational Education and speaks English 
and target language (89.2%) 

3. " Instruction of English &s a Second Language 
^ (ESL) (77.1%) 

4. Multicultural understanding (75.0%) 

r *' . ' > ' - . • ■ . •••\ 

9l) * * 
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Table 14 



fications St^pdard and Criteria 



Standard: 

The program is staffed by qualified personnel 



BVE 

or %. 



4 

VE 



Scale 



CF 



BOTH 

CF 



NONE 



CF 



5 12.8 



7.7 



31. 79.5 Off 0.0 



Criteria: 



A*. 



The program "Is staffed^ by 
qualified teachers/ instruc- 
tional* personnel in the 
following area's: (rate all 
areas) I 

(1) Vocational EducatiorK 

(2) Vocational Education, 
3| English, and target 

language (s) ♦ . 

(3) instruction o^H^iglish 
- ' as a second language 

* (4) Multicultural understandinc 

B. The teacher/ instructional 
qualifications are validated 
by: (rate all methods) 

(1) Florida VE Certification 
(regulcyr or temporary*) 

(2) Approved by loqal school 
loard or board' of trustees 

C. The program is staffed by 
qualified supportive, personnel i 
(rate all) 



. SA 






Scale 1 






J 




Scale 


2 






IV 

A 


u 




u 




SD 


BOTH 1 


BVE 


CF' 


% 


CF 




CF 


% 


CF 


* % 


CF 


% 


CF % 


CF 


- % 


m 


* 




- 


s 


- 


/ - 


* 


' I 

V 


V. ' 








17 


46.0 


19 


51.3 




2.7 


0 


0.0 


0 


0,0 


slf* 85.3 


5 


14.7 










n 










f 








14 


37.8 


19 


5JU+ 


2 


5.4 


2 


5.4 


0 


0.0 


24 82.8 


5 


\1 .2 


13 


37.1 , 


14 


40.0 


1 


2.9 


3 


8.6 


4 


10.4 


19 76.0' 


6 


24.0 


11 


30. b 


16 


44.4* 


5 


13.9 


1 


2.8 


3 


8/3 


17 77.3 
* 


5 


22.7 










\ 


* 




I 


















t 


• \\ 


















✓ 












« 








• 




20 


55.G 


14 


38\9 


2 


5.6 


0 


0.0 


0 


0.J) 


33 100.0 


0 


0.0 


11 


32.4 


12 


35.3 


1 


8.8 


8 - 


* 

23.5 


0 


0.0 


24 96.0 


a 


4.0 
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Table 14—Continued 



(1) Guidance Counselors * 

(a) English speaking only 

(b) Proficient in English & 
target language (s) 

(2) Occupational Specialist 

(a) English speaking only 

(b) Proficient in English & 
target language(s) 

(3) Paraprofessionals 

(a) English % speaffinq only 

(b) Bilingual English & 
' target Language (s) 

— . 











Scale 1 












* Scale 


2 






9A 




A 




U 










BOTH 






CF 


% 


CF 


% 


CF 


% - 


CF 


% 


CF 


% 


CF 


%\ CF 




3 


8.6 




34.3 


3 

♦ 


8.6 


15 


42.9 


2 


5.7 


14 


93.3 


1 


6.7 


11 


30.6 


18 


• 50.0 


2 


5.6 


5. 


13.9 


0« 


0.0 


22 


78.6 


6 


21.4 


3 


8.6 


13 


37.1 


3 


8.6 


15 


42.9 


1 


2.9 


15 


93.8 


1 


6.3 


10 


27/8 


20 


55.6 


'» 


5.6 


1 


2.8 


3 


8.3 


18 


94.7 


1 




2 


5.9 


13 


38.2 


4 


11.8 


14 


41.2 


1 t 


2.9 


13 


86.7 


2 


13.3 


12 


36.0 


17 


5l\5 


2 


6.1- 


2 


6.1 


0 


0.0 


20 


68.0 


9 


31.0 



Sqale: 

BVE .= The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE = The standard is appropriate only fqp^tudents enrolled in traditional Vocational Education 
. (the language of communication is English only) * , 

Both ^ The identified standard is equally relevant to BVE and VE programs 
None ^ The standard is not necessary for an effective BVE and/or VE program 

jSA * Strongly Agree 'that the criterion described would have •considerable impact in meeting the 
standard in an effective WE program 

A % = Agree that *t he criterion described would have a moderate impact^in meeting the standard in 
an effective BVE program 

,* U = Undecided that the criterion described would have any impact in meeting the^standard in an 
effective BVE program * 

n * Disagree that the criterion described would. Jiave any impact in meeting the standard in an 
effective BVE program 

SD » Strongly'Disagree that th^ criterion described would have any impact in meeting the standard 
in an effective BVE program 
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Table 14 Scale: (continued) 

CF * The total number of times that response was selected by all -the respondents 
% * Percentage 'of the total time, that 'response was selected by those who responded to 
the" que s t ionna i r e 

f * The tobal number of times the response was selected within* the school 

Note: The percentage is calculated accoiding to the number of responses to each question and 

' not the total number ,of participants. 
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In addition, thes^ staff qualifications were £pund pertinent 
to "both" by 77% or more of the respondents. 

The methodology identified by £he participants a^s 

» * 

relavant for the validation of teacher/instructional 
qualifications are: (a) Florida VE Certification, Singular 
or temporary (94.4%) ^and/or (b) approved by locaT school 
board or board of trustee's (67.7%). The two identified 

r 

•methods were believed pertinent to "both" by 1CF0% and 96.0% 
* * 

of -the respondents respectively. * ' ^ 

The supportive personnel identified by the partici- 
pants as appropriate for the' instruction of LEP students 
were: (a) guidance counselors who spoke English and- target 
language(s) (80.6%), (b) occupational specialist proficient 
in English and tarcytft language(s) (83.3%), and (e) para- 
professionals proficient in English and target language (s) 
(87.9%). . These criteria were additionally found pertinent 
to "both" by 68.0% or moite of the respondents. 

; - The supportive personnel not found appropriate for 
* \ 

the instruction of LEP students were (a) guidance counselors 
*^b) occupational specialist who spoke English only (45.1%), 

and (c) paraprof ee£ional who spoke English only *(44.1%). 

* o 

The criteria components not found relevant for the 

- 1 / > 

supportive personnel f or*' pro^t^ms with LEP students were, 
further analyze by the types of programs the respondents 
represented, BVE or ESL. Observation of the data shown in 



Table 15 indicates tha| th^ respondents reported that 
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Table 15 

Staff Qualifications by Type of Instructor ✓ 



Scale 



BVE 



VE 



CF - 



CF 



B$f H 

CF 



N ONE 
CF 



standard: 



The program is staffed by qualified personnel 



\ 



XT 



T53T 



Scale 1 



U 



SD 



CF 



CF 



% CF 



% CF 



% CF 



Criterion : 

The program is staffed by 



qualified supportive personnel : ESL 


0 


0.0 


9 90. 


0 


0 


0.0 


• 1 


10 


.0 


0 


0 


.0 


k * ( I ) Guidance 


























\a) English speaking only BVE 


3 


J2.0 


3 12. 


0 


" 3 ? 


12.0 


14 


56 


.0 


2 


8 


.0 


(2) Occupational Specialist 


























(a) English speaking only ESL 


0 


0.0 


8s. 88. 


9 * 


P 


0.0 


1 


l\ 


.1 


0 


0 


.0 


% BVE 


3 


.11.6 


5 19. 


2 


3 


11.5 


14 


53 


.9 


1 


3 


.9 


* (3) Paraprofessiofa!s 


























(a) English speaking o»>ly esl 


1 


11.1 


6 0 66. 


7 


0 


0\0 


,2 


22 


.2 * 


0 


0 


.0 


BVE 


-1 


4.0 


7 28. 


0 


4 


16.0 


12 


^8 


.0 


1 


4 


.0 



jScale: 

ESI, - Staff of English a3 a Second Danquage instruction 

BVE = Staff of Vocational Programs with TEP students enrolled 

SA * Strongly Agree that, the criterion described would have a considerable impact in fneeting the 

standard in an effective BVE program * 
A =* Agree that the criterion described would have a moderate impact in meeting the standard in 

3n effective BVE program ' ^ 
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Table IS , Scale: (continued) 
U 



D 



* Undecided that the criterion described would have any impact in meeting the standard 
in an effective 3VK program 

* Disagree that the criterion described would have any impact in meeting the standard in 
an effective BVfc program 



. SD = Strongly Disagree that the criterion described would have any infract in meeting' the 
standard in an effective BVE program 
Ct> m The total number of times that response was selected by all the respondents 
' - lercentage of the total time that response was selected by those who responded to 
the questionnaire . / 

Notes: The numbers and l^teis are concurrent with those used in the pievioun table and in 
the questionnaire. 

The percentage is calculated according to the total response*, to the question and not 
the number of participants. 
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BSL English speaking suppprt personnel are relevant for the 
LEP student; i.e. 77.8% or more of the respondents * gave this 
response for the guidance counselor, occupational Specialist, 
and paraprofessional . The BVE personnel did nc.-believe that 
the English only support personnel could serve the LEP ?^ 
students enrolled in the program. 

Facilities Standard and Criteria . k • 

. The' standard "The facility enables program objectives 
to be taught" was believed appropriate by 100%«*of the respon- 
dents, as shown in Table 16. The criterion was identified 4 ap 
relevant to the standard when the respondents selected SA 
plus A, a minimum of 60i of the time. 

r 

The first* criterion identified as relevant for the 
above standard was "The classroom labs or shops are 'adequate 
for the instruction>of program objectives in the following 
areas: (a) size (82.1%), (b) ■ *tion ^94. 6%), (cf ^arrange- 
ment (81. 6i), (d) maintenance (79.5%), (e) accessibility for * 
handicapped (71.8%), (f) safety aspects (89.7%), and 
(g) heating/ventilation (89.7%)." These* criteria components 
were found equally relevant for "both" by the respondents 
with a minimum response of 71.8% when a 6Q% minimum was 
needed to^ determine a criterion of component pertinent -to "both" 

The second criterion, "Restrooms, dressing rooms7etc,, 
are conveniently located for: (a) males (100%), >) females 
(87.2%), and (c) handicapped (71.8*)," was shown relevant for 
the standard and pertinent for "both" types of programs by 
100% of the responses. 
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Table 16 



Facilities Standard and Criteria 



, t. 



Standard: a 

The facility* enables program objectives 
to be taught 



BVE 



Sca'I< 



VE 



CF. 



5 12.8 00' 0.0 



BOTH 



^ • NONE 



CF 



CF 



87.1 



Criteria: 

A. The 4 classroom labs, or shops 
* are adequate for the* instruc- 
tion of program objectives in 
the following areas: . {pate* 
'all areas) 
(11 Size 

(2) Location 

(3) Arrangement 

(4) Maintenance 

(5) Accessibility for handi- 
capped students * 

(6) Safety aspects 

( 7 ) ilea t i ng/ven t i 1 a t i on 

(8) Illnjmnation 

(9) Acoustics 

8. Rcstrooms, dressing rooms, etc 
are conveniently ^located for: 
(I) 
(2) 



Scale 1 



Scale 2* 



SA 



SD 



CF 



J2L 



CF 



CF 



CF 



BOTH 

cF 



BVE 



CF 



14 


35.9 


18 


46.2 


I 


2.6 


6 


15.4 


0 


0.0 


28 


* 07.5 


4 


12.5 


15 


40.4 


20 


54.1 


0 


0.0 


1 


2.7 


1 


2.7 


30 


85.7 


5 




11 


29.0 


20, 


52.6 


1, 


2.6 


3 


7.9 


3 


7.9 


25 


89. J 


3 


.10.7 


8 


20.^5 


23 


59 . 0 


5 


12,8 


2 


5.1 


1 


2.6 


28 


90 . i 


3 


9.7 


8 


20.5 


20 


M.3 


5 


12.8 


2 


5.1 


4 


10.3 


2H 


100.0 


0 


0,0 


10 


25.6 


25 


64.1 


2 


5,1 


2 


5.1 


0 


0.0 


34 


100. 0 • 


0 


0,0 


10 


25,6 


2^ 


64.1 


1 


2 # .6 


2 


5.1 


1 


2.6 


24 


92.3 


2 


7.7 


7 


18,9 


28 


75.^ % 


2 


5.4 


0 


0.0 


0 


0.0 


32 


' 94.9 


4m 


' 5,9 


9 


24.3 


25 


67, 6x 


0 


0.0 


2 


5.4 


L 


2.7 


31 


100.0 


0 


0.0 



Male students ' ■ 


21 


53 


.8 


18 


40. 




0 


0.0 


0 


0.0 


0 


0. 


0 


37 


100.0 


0 


0. 


0 

0 


Fcmaic students 


14 


35 


.9 


20 


51. 


3 


0 


0\0 


3 


7.7 


2 


5. 


I 


34 


100.0 


■ 0 


0. 


0 CD 


Handicapped students 


15 


38 


.5 


13 


33. 


3 


4 


10.3 


* 3 


7,7 
• 


4 


10. 


3 


<27 


100, 0 


0 


.0. 


CO 

0 
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Table 16 — Continued 



SA 



.Scale 1 



U 



D 



SD 



BOTH 



S cale 2 



BVE 



Rest rooms, dressing rooms, 
safety directions & charts 
are clearly marked in: 
(rate each one) 

(1) English only 

(2) International symbols 
(I) Target language <s) only 

(4) English 6. target language (s). 



CF 



CF 



CF 



CF 



8 
6 
0' 
7 



21.1 
15.8 
0.0 
18.4 



18 
14 

3 
20 



47.4 
36.8 
8.1 
52.6 



3 
3 
2 
1 



7.9 
7.9 
5.4 
2.6 



7 
10 
21 

6 



18.4 
26.3 
56.8 
15.8 



2 
5 
il 
4 



5.3 
13.2 
29.7 
10.5 



CF 


% 


CF 












22 


91.7 


2 


8.3 


18 


90.0 


2 


10.0 


3 


100.0 


0 


0.0* 


20 


80.0 


5 , 


20 .'o 



Scale: 
BVE 
VE 

Doth 
JJone 
SA 



J 



SI) 
CF 



Note: 



* Jte standard is*appropr iate only for students enrolled In Bilingual Vocational Education 

= TO? standard is appropriate only for students enrolled in traditional Vocational Education 
(the language of communication is English only) 

* The identified standard is equally relevant to BVE and VE programs 
The standard is not necessary fojr In af f ective-BVE and/or VE^program 

= Strongly Agree that the criterion described would have considerable impact in meeting the' 

standard in an effective BVE program 
= Agree' that the criterion described would have a moderate impact in meeting the standard 

in an effective BVE* program * 

* Undecided that the criterion described would have any impact in meeting the standard in 
an effective BVE program 

» Disagree that the criterion described would have any impact "in mating, the standaid in an 
t effective BVE program * 

- Strongly Disagree that the criterion described Would have any impact in meeting' the standard 
in an effective BVE'program* ' - 

- The total number of times that response was selected by all the respondents 

» Percentage of the total time that response Vas selected by those who responded to the 
questionnaire _ My * 

The percentage is calculated accordincj to the number of responses to each question and not 
the total number of participants. 
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The final criterion, "Restrooms, dressing rooms, 
safety directions, and charts are clearly marked 1.-." - 

* (aT English only (68.4%) , and (b) English and target*, ian- 
guage(s) (71.1%), was found relevant for the standard to 
be met. The components (a) international symbols 
(52.6%), and (b) target language only were not found 
relevant by the respondents* for meeting the standard, 

,The analysis of the standard and*its criteria for the 
facilities necessary for, ^Ite effective instruction^of 
LEP students is contained in Table 16. 

^ a . . . 

Th£ anaiy&iS* of the rejected, criterip components 
in reference to the program- areas that the participants 
represent is shown in Table 17. The analysis of data 

* showed that the ESL personnel believed th^ use of inter- 
national syfcbdls is' relevan^but j\dt 4 the^BVjp personnels 

Thl "use of -target language* only was rejected bv both 
. f * " 

groups for meeting the standard. 

Instructional Resources Standard 
and Criteria ^ 

As shown in v Table 18, the standard "Instructional" 

resources are used to. meet program objectiyes" was found 

^appropriate by 94.7% of the respondents for meeting the 

needs of all V2 students. 
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Table 17 1 \^ 
1 Facilities Criterion by Type of InstnSfctor 



1 



Scale 



BVE 



VE 



BOTH 



NONE 



CF 



CF 



% , CF 



CF 



Standard: 

The clvssroom labs< or shops are 
adequate for the instruction of program 
objfu'tive? in tho following: " 



t Sccfrie 1 



Cr i t 01 ion: 



SD 



CF 



% • CF 
»—*-« 



CF 



% CF 



CF 



R«btrooms, .dressing rooms, 
safety directions and charts 
are clearly marked *in: 

{2) -international symbols 



E9L 4 44.4 4 44.4 1 ' ^1%) 0 0.0 0 0.0 
BVK * 10 34.5 2 * 6.9* 10 14 . S 5 17.2 



\ SA 



Rta-ft of English as a Second Language instruction 
Staff of ^rictrttional Programs with LKP students enrolled 

Strongly Agree that the criterion describes! would have a considerable impact in mcetinq the 
standard' in an effaotive BVfi program m * 

Agtee that the criterion described would have a moderate impact in meetinq the standard in 
an effective BVF* program 

Undecided that the ct iter ion def*cribed would have any impact in meeting the standard in 

an *»f (••ft i vr 1 WE progtam & 
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Table 
D 



17 Scales (continued) s 
= Disagree that the .criterion described /sould have any impact in 
in an ofteetive BVE program 4 



■ ^ 



D - - S 



CF 
I 



Note- 



meeting the standard 

program 

Strongly Disagree, that the criterion described wouJd have any impact in meeting the 
standard in an efljective BVK program 
- The total number of times that response was s>elecLe*d by the respondents / ' 4 

= Percentage of * the* total time that response was selected by those who responded 
to the questionnaire 

f ' * - v 

The numbers r 3nd letters are concurrent with those used in the previous lable and in 
the quest ioundi re* 



I 



The percentage is calculated accordinq to the total responses to the question and not 
the number of participants* ^ 
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Table 18 



Instructional Resources Standard and Criteria 



Scale 



BVE 



CF 



Standard; ' 

Instructional resources are used to 
meet program objectives 



CF 



BOTH 

CF 



NONE 
CF 1 



7.9 



2.6 



33 86.8 



ol 



Scale 1 



SA 



U 



CF 



Criteria: 

A, The program has the following 
instructional resources to 
"attain program objectives, 
(rate all resources) 



CF,. 



SD 



CF 



CF 



CF 



CF 



Scale 2 
BOTH_ 



BVE 



CF 



(l) 


Tools and equipment 


15 


41 


.7 


20 


55.6 


1 


2.8 


0 


0.0 


0 


0 


.0 


34 


100.0 


0 


0.0 


(2) 


Vocational instructional 
materials in: (rate all) 






r 






























(a) English only 


10 


27 


.8 


9 


25.0 


3 


8.3 


13 


36.1 - 


1* 


2 


.8 


17 


94.4 


1 


. 5.6 




(b) Englisrt.& target 




































language (s) 


6 


18 


.8 


19 


59.4 


2 


6.3 


.3 


9.4 


2 


6 


.3 


21 


75.0 


7 


25.0 




(c) Target language (s) onlyX 1' 

(d) Components of EnglisTfii 


2 


.9 


2 


5.9 


5 


14.7 


17 


50.0 


9 


26 


5 


2 


66.7 


1 




































target language needed 




































for occupat ion ( i . e . , 




























7o.9^ 








bilingual secr^ary) 


13 


36 


.1 


16 


44.4 • 


3 


8.3 


2 


5.6 


2 


5. 


6 


20 


6 


23.1 


(i> 


English as a second lan- 
guage materials for the 










» - 


























occupational area 


12 


35 


.3 


13 


30.3 


4 


11.8 


1 


2.9 


4 


11. 


8 


15 


' €0.0 


'10 


40. 0. 


(4) 


^Jnsumdble supplies 


12 


33 


.3 


19 


52.8 


2 


6.6 


3 


8. 3 


0 


0. 


0' 


2? 


96.4 


1 


1.6 
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Table 18— Continued 



u 



(5) Related Resources (equip- 
ment, livestock, human 
subjects, etc.) 

(6) Audiovisual materials 

D. Tools and equipment in this 
program are similar to those'" 
used in business and 1 industry 

C. Tools and equ ipmen^have the 
necessary safety devices 

D. If tools and equipment, break, 
service* is available to repair 
them 

E. Worn, bruken or outdated tools 
and equipment are replaced 

P. Instructional materials in this 
program are nondiscriminatory 
in content toward: (ratq. all) 

(1) Males 

(2) Females 

(3) Races 

(4) Hand i capped 

(5) Ethnic groups* 

(6) Limited English speaking 



Scale: 



spe next page 



Scale I 



SA 



Scale 2 



BOTH 



_A U D SD 

CF % CF % CF % . CF^ % CF % CF % CF 



BVE 



7 26. S 18 52.9 6 17.7 1 
11 29. / 23 62.2 3 8.1 ^0 



16 47.1 18 52.9 0 0.0 0 
t 

15 42.9 20 57.1 0 0.0 0 



2.9 0 0.0 26 92.9 2 7.1 
0.0 0 0.0 32 97.0 1 3.0 



0.0 0 0.0 33 97.1 1 2.9 



0.0 0 0.0 34 97.1 



1 2.9 



13 


37.1 


19 


54.3 


1 


2.9 


2 


5.7 


0 


0.0 


31 


96; 9 


1 


3.1 


12* 


33.0 


16 


44.0 


1 


2.9 


. 6 


17:0 


1 


2.9 


27 


96 . 4 


1 


3.6 


17 


47.2 


17 


47.2 


2 


* 5.6 


0 


0.0 


0 


0.0 


33 


97.1 


L 


2.9 


16 


44 4 


18 


50.0 


2 


5.6 


0 


0.0 


0 


0.0 


33 


97. 1 


1 


2.9 


16 


44.4 


18 


50.0 


2 


5.6 


0 , 


0.0 




0.0 




?7.1 


1 


2.9 


16 


44.4 


17 


47.2 


2 


5,6 


> 1 


2.8 


0 


0.0 


30* 


96.8 


1 


3.2 


17 


47.2 


17 


47:2 


2 


5.6 


0 


0.0 


0 


0.0 


27 


84.4 


5 


13.6 


15 


41.7 


16 


44.4 


4 


11.1 


1 


2.8 


0. 


0.0 


28 


90.3 


3 


9.7 
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Table 18 Scale: 

BVE * The standard is appropriate only for students entolled in Bilingual Vocational Education 
VE * The standard is appropriate only for students enrolled in traditional Vocational Education 

(the language of communication is English only) 
Both • Tue identif ied standard is equally relevant to BVE and VE programs 
None « The standard is, not necessary for an effective BVE and/or VE progra«^ 
SA = Strongly Agree that the criterion described would have considerable impact in meeting 

the standard in an effective BVE program 
A =* Agree that the criterion described would have a moderate impact in meeting the standard 

in an .effective BVE program ^ • 

U ■ Undecided that the criterion described would have any impact in meeting the standard in 
^effective BVE program , 

D « Disagree that the criterion described would have any impact in meeting *he standaid in an 

effective BVE program , 
SD * Strongly Disagree that the criterion described would have any impact in meeting 

the standard in an effective BVE program % 
CF " * The total number of times that response was selected by all the respondents 
% * Percentage of the total time that response was selected by' those who responded to the 

questionnaire \ 
f - The total number of times the response was selected ^within the school 

Not**: The percentage is calculated according to the number of responses to each question and j 
not the total number of participants. 
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. 96 

The criteria and/or its components (see Table 18) 
were found relevant for the standard .when a minimum of 
60% of the participants, selected SA plus A response. The 
first criterion, "The program has the following instruc- 
tional resources to attain program objectives , " was found 
relevantly the respondents for. the following components: 
(a) tools and equipment (97.2%); (b) vocational instruc- 
tion in English and target language (s) (78.1%); components' 

• r 

of English and target language needed for occupational 
area (90.6%); consumable supplies (86.1%); related 
resources (equipment, livestock, human subjects, etc.) . 
(79.4%); audiovisual materials (91.9%); and?English as 

Ar 

a Second Language materials for the occupational area 
(73.5%). These identified, relevant criteria were addi- 
tionally found pertinent to "both*, with a 60% or more 
response. A minimum of 60% of the respondents had to 
^elect "both/ 1 for the criterion and/or its components 
to be considered ^ertinent to BVE and VE programs with 
L r P student? enrolled. 

The criterion components that were rejected by 

> 

, the participants for the above stated criterion were, 
(a) vocational instructional materials^in English only 
(52.8%), and (b) vocational instructional materials in 
target language(s) only (8.8%). The data were further 
analyzed by' the program areas which the participant 
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/ 97 
represented , BVE or ESL» The analysis showed the ESL 
staff (77.8%) responded that English only vocational ipstruc- 
tional materials are relevant for meeting the standard, 
but not the BVE staff (44.4%) (see Table 19). \ 

The criterion Instructional resources are used 
to meet program objectives, was found relevant to the stan- 
dard, i.e., 77.8% of the' respondents selected SA plus A. 
The relevant criteria are:-, ^4) tools and equipment in this 
.^pr6gr^m. are similar to thosa used in business and industry, 
- (b) tools and equipment have the necessary safety devices, 
(c) if tools *nd equipment 'break ; service is available to 
repair ;them, (d) worn, broken or outdated tools and equip- 
ment are replaced, and (e) instructional materials in v this 
program are nondiscriminatory in content toward males,, 
females, races, handicapped, ethnic groups or LEP. These 
above stated criteria were additionally found pertinent to 
"both" with. a minimum response of 84.4% of the responses, 
when a minimum of 60% response was required fon a criterion 
c* its* component to be pertinent for "both." 

Recruitment Standard and s* 
Criteria 

The need for "an active recruitment program for 
students" was a standard found appropriate ^by 78.9% of the 
respondents to the question as shown in Table 20. 

The following criteria also 3lv?wn in Table 20 were 
identified by a minimum of 7*0% of the respondents to be rele- 
vant for meeting the abovfc Standard:, (a) orientation 
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, Table 19 

Instructional Resources Criterion by Type of Instructor 



SA A U P S p ; 

Cf5 % CF % "CF % "CF I *CF 4 



Standard : 

Instructional resources are 
used to fheet program objectives. 

Criterion: „ 

A„ The program has the following 

instructional resources to 

* 

attain program objectives 
(2) Vocational ^instructional 

materials fn* ESL 4 44.4 3 33.3 1 11.1 1 U.l 0 0.0 

6 22.2 * 6 22.2 2 7.4 12 44.4 1 4.0 



(a) English only BVE 



Scale: . , . ^ 

ESL * Staff of English as a Second Language instruction f 
BVE-» Staff of Vocational Programs with LEP students enrolled 

SA - Strongly Agree that the criterion described would have a considerable impact in meeting the 

standard in an effective BVE program 
A - Agree that the criterion described would have a moderate impact in meeting the standard in 

.an effective BVE program 
0 * Undecided that the criterion described would have any impact in meeting the standard m 

an effective BVE program . 
D » Disagree that the criterion described would have any impact in meeting the standard m 

an effective BVE program 
SD » Strongly Disagree that the criterion described would have any impact in meeting the 

standard in -an effective BVE program £ 

GO 
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Table 19 Scale: (continued) 

CP « The total number of times that response was selected uj the respondents 
1 ■ Percentage of the total tine that response was selected by those who responded 
to the questionnaire 

Hot*s: ,The numbers and letter? are concurrent with those used in the previous table and 
[ in the questionnaire* 

l * ' 

The perpentage is calculated according to the total responses to the question 
and not the number of participants* 



• 
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Table 20 

Recruitment Standard and Criteria 

* 



BVE ' 
CF % 



Standard : 

The program provides an active recruitment 
program for students 
1 



Scale 
VE 

CF 



BOTH 
CF % 



NONE 
CF \ 



2.6 



4 10,5 29 76.3 



4 10.5 



Criteria : 

A. Orientation sessions are held 
to acquaint students with the 
program. 

(1) multilingual staff par- , 
ticipate in recruitment 
program 

B. Printed information is provided 
to acquaint students with the 
program 

(1) printed material is pro- 
vided in: (rate all) 

(a) English only 

(b) Target language (s* only 

(c) English & target 
language (s) 

C. Community resources that are 
used tq provide information to 
prospective students 

(1) The community resources 
that are used: (rate all) 
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SA 
CF % 



A 

CF % 



Scale 1 
U 

CF % 



Scale 2 



SD 



CF 



CF 



BOTH 
CF '% 



BVE 
CF % 



9 


28.1 


18 


56.3 


2 


6.3 


3 


9.4 


0 


0.0 

t 


17 


65.4 


9 


34.6 


3 


10.0 


10 


33.3 


3 


10.0 


10 


33.3 


, A 


13.3 


11 


91 .7 


1 ' 


8.3 


1 


3.3 


4 


13.3 


8 


26.7 


12 


40.0 


5 


16.7 


4 


80.0 


1 


20.0 


16 


51.6 


11 


35.5 


2 


6.5 


' 2 


6.5 


0 


0.0 


14 


51.9 


11 


48.1 



o 
o 
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Table 20 Continued 



Scale 1 



Scale 2 







SA 




A 




u 




D 


SD 


BOTH 




BVE 






CF 


% 


CF 


% 


CF 


.. * 


CF 


% 


CF 


% 


CF 




CF 


% 




(a) Radio & TV 
































a.l English only 
















\ 


L 














programs 


2 


6.5 


9 


29.0 


1 


3.2 


16 


.51.6 




9.7 


9 


90.0 


1 


10.0 




a. 2 Target language 
































program (s) 


6 


19.4 


7 


22.6 


9 


29.0* 


7 


22.6 


2 


6.5 


5 


41.7 


*8 


6*6.7 




9.3 Both English and 
































target language 
































program (a) 


10 


31.2 


16 


50.0 


0 


0.0 


6 


18.8 


0 


0.0 


19 


73.0 


7 


' 27.0 




(b) Newspapers , 






























♦ 


fc>.l Encrlish lanouaae 
































only 


o 


- o • / 


7 


23. 3 


\ 


in n 


1 9 


a ft • n 


6 


20 .0 


8 


88.9 


i 
i 


> i i 




b.2 Target language (s) 
































only 


c 
3 


ID • / 


1 0 


33 . 3 


A 
*% 


n i 


Q 

o 


Oft *7 


3 


10 .0 


6 


40 .0 


Q 

^7 


uU • U 




b.3 Both English and 




















• 










• 


target language (s) 


11 


37 .0 






-y 


O • D 


D 


1 Li A 


0 


0.0 


17 


80. S 


A 
H 


« in i 
XV • X 




(c) Social organizations 
































c.l social services 








» 
























agencies 


7 
§ 


<i J • j 




70 . 0 


p 




n 


n n 


U 


IJ . U 


1 J 


/U • 4 


U 
O 




4 


c.2 Ethnic clubs 


9 


30.0 


18 


60.0 


3 


io. d 


0 


0.0 


0 


0.0 


19 


76.0 


0 


24.0 


All 


students are encouraged to 






























enter the program: (rate all) 






























(1) 


Hale c 


16 


51.6 


,15 


48.4 


0 


G.O 


0 


0.0 


0 


0.0 


29 


96.7 


1 


3.3 ■ 


(2) 


Female 


16 


51.6 


15 


48.4 


0 


0.0 


0 


0.0 


0 


0.0 


2 C J 


96.7 


I 


J. 3 


(1) 


From ethnic groups living 
































in the area 


16 


51.6 


15 


48.4 


0 


0.0 


0 


0.0 


. f 

0 


0.0 


29 


9b. 7 


1 


' 3.3 


(4) 


From rc^es living in the 




























S.7 




area 


17 


54.8 


14 


$5.2 


0 


0.0 


0 


0.0 


0 


0.0 


24 


92. J 


2 


(5) 


Limited English speaking 


15 


46.9 


12 


37.5 


2 


6.3 


3 


9.4 


0 


0.0 


4 24 


92.3 




7.7 


(6) 


Handicapped 


15 


46.9 


14 


45.2 


2 


6.5 


0 


0.0 


0 


0.0 


26 


96.3 


t 


3_7m 



Scale: see next page 
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Table 20 Scil$: 

*VB • TliieWandard is appropriate only for students enrolled in Bilingual Vocational Education 
VE * The standard is appropriate only for students enrblled in traditional Vocational 

Education (the language of communication is English only) 
Both ■ The identified standard is equally relevant to BVE and VE programs 
None * The Wtandatd is not necessary for an effective BVE and/or. VE program 
SA * Strdngly Agree ^\jat the criterion described would have considerable ilnpact in meeting 

the/standard in al^ effective BVE program 
A » Undfecided that the criterion described would have any impact in meeting the standard in 

an Affective BVE program, 
U ■ Undecided that the criterion described would have any impact 'in meeting the standard 

in an effective BVE program * 
D « Disagree that the criterion described would have any impact in meeting the standard 
in an effective BVE program - ,1 
* SD « Strongly Disagree that the criterion described would have any impact in meeting the 
* standard in an effective BVE program 
CP » The total number of times that response was selected by all the respondents 
% * Percentage of the total time that response was selected by those who responded to the 

V questionnaire * v 

t * The total number of times the response was selected within the school 

Hote: The percentage is calculated according to the number of responses to each question and 
not the total number of participants. 
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sessions are held to acquaint students with th^ program, 



multilingual staff participate in recruitment, (b) printed • 
information is provided to acquaint students with the pro- 
grams? printed material is provided in English ar^ target 
language(s), and fcf" community resources that are used to 
provide information to prospective students; radio and T.V. 
* in English and target language (s) ; newspapers in English and 

*> target language (s) ; social organizations, social services 
agencies, ethnic clubs; all students are encouraged to enter 
the prbgram, male* female, from ethnic grouos living in 
area, from races living in the area, LEP and Handicapped. 
The criteria that were identified as relevant for the stan 4 - 
dard and cited above were additionally found pertinent 
to "both" by the respondents with a minimum response of 
70% when only 60% was necessary for a cariterion and/or 
its component to be considered pertinent to "both," 

The criterion components that- were rejected by the 
data from the respondents that were analyzed: .(a) printed 
information is provided in English only (43.33%) , target 
language(s) only (16.7%), and (b) community resources that 

* are used: radio and T.V. English only programs (35.5%), 
target language(s) only (41. 9£); newspapers English language 
only (30.0%) target language only (50%).* Further analysis of 
the participants 1 responses to the rejected criteria com- 
ponents by u program areas represented by the respondents indi- 
cated that the ESL staff supported the use of English only 

131. 
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in all areas whereas the BVE personnel rejected it in, all 
areas. (See Table 21.) 
Admission Standard and Criteria 

4 

The stapdard "Admissions procedures for the program 
are operational" were found appropriate for'vfe programs 
with LEP and English speaking (ES) students by 94.5% of 
the respondents to the question (see Table 22). *i 

The criterion was identified as relevant 'for the 
standard when a minimum of 60% of the respondents selected 
SA plus A (see Table 22) . The criteria that were identified 
as. relevant for the standard above were: (a) academic 
prerequisites are specified for students in target language 
plus some English knowledge (64.7%), (b) students ;enroll,ed 
in the program are at proper grade level as specified in the 
Course Code Directory-Public Schools 1980-81 (87. 1%^/ (c) the 
admission procedures are developed by administrators (91.2%) , 
and counselors (71.4%), (d) teachers assist in the selection 

of students who enter the'program (67.7%) > and (e) teachers 

* 

work with Student Service personnel to provide students with 
v 

information about occupations (90.9%). The above named 
criteria with the exception of (a) were believed -by at 
least *6% of the respondents to be pertinent to "both" when a 
minimum of 60% was necessary to identify a criterion or its 
component as being pertinent. Tht? criterion (a) Academic 
prerequisites are specified for students in target language 
plus some English knowledge was not iround relevant (17;8%). 
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Table 21 

Recruitment Criteria by Type of Instructor 



Standard: . 

The program provides an active 
recruitment progr&m for 
students 

Criteria! 

B. Printed information is pro 
to acquaint students with 

„ program 
(1) Printed material is 
provided in 
(a) English only 

C. Community resources that 
a*$ used to provide infor- 
mation, to prospective stu- 
dents \ 

(1) Hie community resources 
that are used: 

(a) Radio & TV 
a.l English only pro- 
gram- ?: . 

a. 2 target language 

programs 

(b) Newspapers 

b. l English language 
/ only 

b,^ Target language (s) 
only 



FSL 
BVE 



SA 



CF 



CF 



CF 



CF 




11.1 
9.5. 



4 

6 



44.4, 
28.6 



0 
3 



0.0 

5 i.^ 



4 

6 



44.4 

28. £ 



CF 



0 
4 



SD 



Scales see .next page 
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0.0 
15.0 



ESL 


1 


11.1 


4 


44.4 


■ 0 


0.0 


4 


44.4 


0 


0.0 




BVE 


1 


4.6 


5 


22.7 


1 


4.6 ' 


12 


54. * 


3 


13.6 




ESL 


1 


11.1 


? 


22.2 


0 


0.0 


6 


66.6 


0 


0*0 




BVE 


5 


22.7 


4 


22.7 


9 


40.9 


1 


4.5* 




9.1 




ESL 


1 


11.1 


4 


44.4 


0 


0.0 


4 


44.4 


0 


0.0 




BVE * 


1 




3 


14.3 


3 


14.3 


8 


38.1 


$ 


28.6 




,ESL 


1 


11.1 


3 


33.3 


1 


11.1. 


" 4 


44.4 


0 


* 0.0 


H» 


BVE 


4 


19.7 


7 


33.1 


3 


14.3 


4 


19. J 


3 


14.3 


O 

LP 
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Table 21 Scale: • 

ESL » Staff of English as a Second Language instruction 

BVE - Staff of . Vocational Programs with LEP students enrolled 

SA « StronglV Agree that the criterion described would have a considerable impact* in meeting 

the standard in an effective BVE program "~ 
A » Agree that the criterion described would have a moderate ;npact in meeting the standard 

in an effective BVE program 
U >»^tJndecidpd that the criterion would have any impav, in meeting the standard in an 
effective BVE program 

D = Disagree that the criterion described would have any impact in meeting the standard . 

in an effective BVE program 7> 
SD « Strongly Disagree that the criterion described would have any impact in meeting the 

standard in an effective BVE program 
CF « The total number of times that response was selected by the respondents * 
* * Percentage of the time that response was selected by those who responded to the 
questionnaire 



Notes: The numbers and letters are concurrent with those used in the previous table and 
in the questionnaire. 

i 

The percentage is calculated according to thte total responses to the question and not 
the number of participants. 
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Tabje 22 
Admission Standard and Criteria 



, Scale 

BVE VE BOTH NONE 
^ \ CF % CF % CF % CF % 

Standard: 

Amissions prdbedures for the program are 

operational 1 2 .5.6 33 91.7 0 0.0 



Scale 1 jracale 2 



TOTH 



SA A U . D SD TOTH BVE 

CP % *^F % CF % CF % CF % CF % ' CF 
Criteria: ~~ ~ ' : 

A. Academic prerequisites are 
specified for students in: 
(rate all) 

(1) English only 

(2) Target language plus some 
English knowledge 

(3) English plus some knowledge 
>;'" of target language 
? {4f , Target language (s) only 

(5) English or target language (a) 6 17.0 10 

B. Students enrolled in the progcam 
are at proper grade level as 
specified in the Course Code 
Directory-Public Schools 
1980-81 

C. The admission procedures are 
developed 'by: (rate all) 

(yr< Administrators 23.5 22 64.7 1 2.9 2 J 5.9 0 0.0 21 96.7 1 3 . 3 

c 



7 


20.0 


8 


22.9 


5 


14.3 


12 


34.3 
/ 


3 


8.6 


13 


86.7 


2 


13.3 


4 


11.8 


13 


38.2 


9 


26.5 


8 


23.5 


0 


0.0 


7 


46.7 


8 


53.3 


1 


2.9 


19 


54.3 


6 


17.1 


9 


25.7 


0 


0.0 


12 


60.0 


8 


40.0 


1 


2:9 


5 


14.7 


12 


35.3 


11 


32.5 


5 


14.7 


2 


28.6 


5 


71.4 


6 


17.0 


10 


28.6 


8 


22.9 


10 


28.6 • 


1 


2.9 


9 


60.0 


6 


40.0 


7 


i2.r, 


20" 


i4.5- 


2 


26.5 


2 


6.5 


0 


0.0 


25 


i) 

100.0 


0 


0.0 
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Table 22~qontinued 



(2) Counselors 

(3) Teachers 

(4) School support personnel 

(5) Parents 

(6) Community representatives 

D. Teacher (s) assist in the selec- 
* tion of students who enter the 

program 

E. The criteria used for student 
admission into the "Work Expe- 
rience* 9 program are: (rate all) 

(1) Truancy problem 

(2) Need work in order to con- 
tinue education 

(3) Deprived economically 

. (4) Negative attitude towards 

(a) work ^ 

(b) -school 

(c) society 

(5) Poor self -concept 

(6) Alienation 

(7) Discipline problem 

(8) Half-day- performer 
(lin*it6d atittRitjjpri span) . 

(9) OMlE-age in grade 

(10) Not relating to classwork 

(11) Lack of interest 
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Scale 1 



Scale 2 



SA 



U 



SD 



BOTH 



CP 



9 
8 
7 
3 
5 



CP 



CP 



BVE 



CF 



CP 



CP 



CF 



-26.5 
22.9 
20.0 
9.1 
14.3 



22 
17 
13 
5 

10, 



64.7 
48.6 
37.1 
15.2 
28.6 



N 2.9 
2.9 
8.6 

12.1 



2 
9 
12 
13 



5.9 
25.7 
34.3 
39.4 



0 
0 
0 
8 



0.0 
0.0 
0.0 
24.2 



21 
23 
19 
7 



95.5 
95.8 
95.0 
87.5 



8.6 11 31.4 6 17.1 11 91.7 



( 



1 4.5 

1 4.1 

1 . 5.0 

1 12.5 

F 8.3 



6 


19.4 


15 


48.4 


5 


16.1 


2 


6.5 


3 


9.7 


20 


95.2 


1 


4.8 


5 


15:2 


8 


24.2 


14 


42.4 


4 


i 

12.1 


2 


6.1 


13 


100.0 


0 


0.0 


10 


30.3 


16 


45.5 


3 


9.1 


3 


9.1 


1 


3.0 


24 


96.0 


1 


4.0 


7 


23.3 


19 


63.3 


3 


10.0 


1 


3.3 


0 


0.0 


25 


96.2 


1 


3.9 


4 


12.1 


12 


36.4 


6 


18.2 


9 


27.3 


2 


6.1 


15 


93.8 


1 


6.3 


5 


14.7 


.12 


35.3 


4 


11.8 


12 


35.3 


'l 


2.9 


17 


100.0 


0 


0.0 


5 


15.2 


10 


30.3 


5 


15.2 


11 


33.3 


2 


6.1 


11 


91.6 


1 


8.3 


6 / 


18^ 


12, 


37.5 


6 


18.8 


6 


18.8 


2 


6.3 


17 


94.4 


1 


5.6 


4 


12.5 


11 


34.4 


4 


12.5 


12 


37.5 


1 


3.1 


14 


93.3 


1 


6.7 


6 


18.8 


8 


25.0 


6 


18.8 


10 


31.3 


2 


6.3 


12 


100.0 


0 


0.0 


5 


15.2 


12. 36.4 


5 


15.2 


10 


30.3 


1 


3.0 


16 


94.1 


1 


5.9 


5 


12.8 


21 


52.9 


3 


7.7 


5 


12,8 


5 


12.8 


23 


95.8 


1 


4.2 


6 


18.2 


14 


42.4 


6 


18.2 


4 


10.0 


3 


9.1 


7 


8.8 


1 


12.5 


9 


28.1 


8 


25.0 


5 


15.6 


9 


28.1 


1 


3.1 


13 


92.9 


1 


7.1 



/ 



o 

CD 
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Table 22 — Continued 



* 










Scale 1 






Scale 2 




SA 


i 


A 


U 


. D 


SD 


PCTH BYB 




CF 


% 


CF 


% 


CF % 


CF % 


CF % 


CF % CP % 


F. Teachers work with Student 


















Service personnel to provide 
students with information 


• 














r • 


about occupations 


14 


42.2 


16 


48. § 


o o.o- 


1 3.0 


2 6.1 


29 96.7 1 3.3 


• 

6. Students service personnel help 
develop flexible schedules to 












r 






meet special needs of "Work 


















Experience" students 


14 


42.4 


11 


33.3 


5 15.2 


1 3.0 


2 6.1 


24 96.0 1 4.0 

ft 1 ■ ■ . . 



Scale: / 

BVE - The standard' is appropriate only for students enrolled 'in Bilingual Vocational Education 
VE - The standard is appropriate only for students enrolled in traditional Vocational Education 
Both » The identified standard is equally relevant to BVE and VE programs 
None » The standard' is not necessary for an effect^e BVE and/or VE program 

SA • Strongly Agree that the criterion described would have considerable impact in meeting the 

standard in an effective BVE program 
A » Agree that the criterion described would have a moderate impact in meeting the standard in 

an effective BVE program 
U - Undecided that the criterion described would have any impact in meeting the standard in 

an effective ByE program 
D * Disagree £hat the criterion described would have any impact in meeting the standard in 

an effective BVE program 

SD - Strongly Disagree that the criterion described would have any impact in meeting the standard 

in an effective BVE prog tarn 
CP - The total number of times that response was selected by all the respondents 
% ■ Percentage of the total time that response was selected by those who responded to the 

questipnnaire * 
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fable 22 Scale t (continued) 

£ * The totel number of times the response was selected within the school 

Bote* The percentage Is calculated according to the number of responses to each question * 
and not' the total number of participants. 
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The criteria that specifically refer to the "Work 
experience Programs" were reported but not incorporated into 
the. BVIPRC for the reason that few participants were familiar 
with "Work Experience" and no programs identified. The cri- 
taria ^t~h» * w ere found relevant for the standard were: (a) the 
criteria used for students admission into the "work Experi- 
ence" vprogram are: need work in order to continue education 
(75.5%) ,\ deprived economically (86.7%), over-age in grade 
(66.7%), and not relating to classwork (66.6%), (b) teachers 
work with Student Service personnel to provide students 
with information about occupations (90.9%), and (c) stu- 
dents^ service personnel help develop flexible schedules 
to meet special needs of "Work Experience - ' students (75.8%). 1 
'The previously identified criteria and their components 
were also found pertinent to "both" by a minimum of 87.5% 
of the responses. 

The criterion components that were rejected by 
the analysis of the participants' responses were: 
(a) Academic prerequisites are specified for students in 
English only (42.9%), English plus some knowledge of target 
language (57.1%), target, language (s) only (17.7%), and 
English or target language(s) (45.7%), (b) the admission 
procedures are developed by: teachers (57.1%), school 
support personnel (42.9%), parents 24.2%) , and community , 
representatives (42.9%). 

lit? 



112 

The criterion for components that were rejected were 
further analyzed in reference to the program areas that the 
participants represented, ESL or BVS. The analysis of these 
data showed the following:* (a) English only prerequisites 
for student admission were believed relevant^ by the ESL 
(77.0%) staff but not the BVE (30.8%) English plus some 
knowledge of the target language was believed relevant by 
the ESL (66.7%), but not the BVE (53\9%), target language(s) 
only wejre not believed relevant by either group, nor was 
the use of English pr target language (s) ; (b) the admission 
procedures . are developed by teachers. was believed relevant 
by the ESL (100%) but not by the BVE staff (42.3%) school 
support personnel was believed relevant by the ESL (66.7%) 
staff but not the BVE (34.6%) 3taff, parents were believed 
relevant by the ESL staff (66.7%) , but? not by the BVE 8.3% 
staff; community representatives were believed relevant by 
the ESL (66.7%) but not the BVE (34.6%) staff (see Table 23) . 

Ths criterion components that were rejected for 
the "Work Experience" program were also further analyzed 
9 by the program areas the participants represented. It 
was shown that each rejected criterion was believed rele- 
vant by the ESL group but not the BVE group. 
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Table 23 

Admission Standard and Criteria by Type of ^^Tnstructor 









. SA 






» 

A 




U 




D 




sp 






CF 


% 


CF 


% 


- CF 


% 


CF 


% 


Standard: 




















* -9* 






Admissions procedures for the 
























program are operational 




1 




















A. 


Academic prerequisites are 










*• 








/ 








specified for students in: 


ESL 


c 
D 


55.6 


2 


22.2 


1 


11.1 


1 


11.1 


0 


0,0 




(1) English only % 


BVE 


Z 


7 . 7 


6 


23.1 


4 


15.4 % 


11 


42.3 


3 


11.6 




(3) English plus some 












* 










• 




knowledge df target 


ESL 


1 


11.1 


5 


55.6 


\ 0 


0 0 






n 






language 


BVE 


0 


0.0 


14 


53.0 


6 


30.' 




24. 0 








(4) Target language (s) 


ESL 


1 


12 .5 


1 


• 12.5 


0 


0.0 


5 


62.5 


1 


12.5 




Qnly 

■» 


BVE 


0 


0.0 


4 


15.4 


12 


46.2 


6 


23.1 


4 


15.4 


c. 


The admissions procedures 




• 












< 

9 










are developed by: 


ESL * 




55.6 




44.4 
















> 


5 


4 


0 


0.0 


0 


0.0 


0 


0.0 




(31 Teachers 


BYE 


. 2 


7.7 


9 


34.6 


3 


11.5 


12 


46.2 


0 


0.0 




(4) School support 


ESL 


3 


33.3 


.3 


33.3 


1 


11.1* 


2 


22.2 


0 


0.0 




personnel 


BVE 


0 


0.0 


9 


34.6 


11 


42.3 


3 


11.5 


3 


11.5 




(5) parerits 


ESL 


3 


33.3 


3 


33.3 


0 


0.0 


3 


33.3 


0 


0.0 






BVE 


0 


0.0 


2 


8.3 


4 


16.7 


10 


41.7 


8 


33.3 


E. 


The criteria used for 




V 






















student admission into 


























the "Work Experience w 


























program are: 


ESL 


4 


50.0 


1 


12.5 


.2 


15. C 


1 


12.5 


0 


0.0 




(1) Truancy problem 


BVE 


1 


4.0 


7- 


28.0 


12 


48.0 


3 


12.0 


2 


8.0 




V 



Table 23 — Continued 



u 



CF 



CF 



CF 



CF 



SD 



CF 



(4) 


Negative attitude toward: 


























(a), work 


ESL 


4 


50.0 


4 


50.0 


o 


6 o 


o 


0.0 


o 


0.0 






BVE 


0 


0.0 


8 


32.0 


6 


2*.0 


9 


36.0 


2 


8.0 




(b) School 


ESL 


4 


50.0 


3 


* 37.5 


1 


12.5 


0 


f 0.0 


0 


0.0 






BVE 


1 


3.9 


9 


34.1 


3 


11.5 


12 


46.2 


11 


3.9 




lc) society 


ESL 


4 


50,0 


4 


50.0 


0 


M).0 


0 


0.0 


0 


0.0 






BVE 


1 ' 


4.0 


6 


24.0 


5 


20.0 


11 


44.0 


2 


6.0 


(5) 


Poor selr -concept 


ESL - 


4 


50.0 


4 


50.0 


0 


0.0 


0 


0.0 


n 


0.0 






BVE 


2 


8.3 


8 


33.3. 


o 


25.0 


6 


25.0 


2 


8.3 


!6) 


Alienation 


ESL 


4 


30^0 


3 


37.5 


1 


12.5 


0 


0.0 


0 


0.0 






BVE 


0 


0.0* 


8 


33.3 


3 


12.5 


12 


50. 0 


1 


4.2 


(7) 


Discipline problem 


ESL 


4 


50.0 


2 


25.0 


2 


25.0 


> 0 


0.L 


0 


o.o 






BVE 


2 


8.3 


6 


25.0 


4 


16.7 


10 


41. ' 


2 • 


8.3 


<*> 


Half -day performer 


ESL 


4 


50.0 


3 


37.5 


1 


12.5 


0 


0.0 


0 


0.' 




(limited attention span) 


BVE 


i 


3.9 


8 


33.3 


4 


16.8 


10 


4a. 


1 


3. a 


(11) 


Lack of interest 


ESL 


5 


62.5 


2 


25.0 


.1 


12.5 


0 


0.0 


0 


0.0 






BV? 


4 


16.7 , 


6 


25.0 


4 


16.7 


9 


37.5 


1 


4.4 



Scale: 
ESL 
BVE 
SA 



« Staff of English* as a Second Language instruction 

■ Staff of Vocational Programs with LEP students enrolled 

■ Strongly Agree that the criterion described would have a considerable impact in meeting the 
' standard in an effective BVE program 

* Agree that the criterion described would have a moderate impact in meeting the standard in 

aft effective pVE program 
v Undecided that the criterion described would have any impact in meeting the standard in an 

effective BVE program 
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Table 23 Scale * (continued) 

D » Disagre that the criterion described would have any impact in meeting the standard 

* in an effective DVE program 

SD » Strongly Disagree that the criterion described would have any impact in meeting the 

» standard in an effective BVE program 

CF « The total number of times that response was selected by the respondents 

% * Percentage of the total time that response was selected by those who responded 
* to the questionnaire * 

Notes: The number and letters are concurrent with those used in the previous table and in 

the questionnaire. 

The percentage is calculated according to the total .responses to the question and 

not: the number of participants. 
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s 

Class Enrollment Standard 
andi Criterion 

- * ^ The standard "Classroom enrollment is limited to 

> 

permit students to attain the program objectives" was 
believed appropriate by^f4.4% of the respondents for "both" 

and "BVfe only 19 as shown in Table 24. A minimum of 60% 

► 

response both *both" and/or "BVE only" was necessary for 
the standard to be appropriate for the instruction- of 
LEP students enrolled in the vocational programs.. 

The criterion for class, enrollment also shown in 
Table 24 , "The enrollment is restricted to provide stu- 
dents with the opportunity to obtain -program objectives" 
waa perceived as relevant by 91.7% of the respondents. 
A minimum of 60% of the responses from* the participants 
was required to be "SA and/or A" for the criterion to be 
identified as relevant for meeting the standard. The 
criterion was additionally identified as pertinent' for 
"both" types of programs , PVE and VE, by 96.6% of the 
Respondents . * * 

Instruction Standard and Criteria 

The analyses of data for the standard and criteria 
for the instruction of the LEP students enrolled in the 
vocational program is shown in Table 25. The standard 
"Instruction is organized in order to assist students 
in meeting program objectives" was believed appropriate 

153 




Table 24 

Classroom Enrollment Standard and Criterion 



Scale . 

BVE VE / BOTH NOME 

CF % CF % I CF % CF % 

Standard : 

Classroom enrollment is limited tc permit * 

students to attain the program objectives - 2^ 5,6 - 1 2.8 32 88.9 1 1 2.8 



* : Scale 1 Scale 2 

SA * A U D SD BOTH. BVE 

CF % CF % CF % CF % CF % CF % CF % 

Criterion i 

A. The enrollment is restricted to 
provide student* with the oppor- 
tunity to obtain program objec- f 

tives 21 58.3 12 33.3 0 0.0 1 3 8.3 0 0.0 28 96.6 1 .3.5 



Scale: . . _ . _ s 

BVE « The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE * The standard ^ is appropriate only for students enrolled in traditional Vocational Education 

, (the language of communication is English only) 
Both * The identified standard is equally relevant to BVE and VE programs 
None « The standard is not necessary for an effective BVE and/or VE program 

SA » Strongly Agree that the criterion described would have considerable impact in meeting the 

standard in an effective BVE program 
A ■ Agree that the criterion described would have a moderate impact in meeting the standard in 

an effective BVE program 

U « Undecided that the criterion described would have any impact in meeting the standard in an 
effective BVE program 

D » Disagree that the criterion described would have any impact in meeting the standard in an 

effective BVE program * h» { * 

SD » Strongly Disagree that the criterion descr ibcjjJ would have any impact in meeting the standard 
in an effective BVE program k 
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Table 24 Scales (continued) ' ' , 

CF ■ ^ total number of times that response was selected by all the respondents 
% ■ Percentage of the total time that response was selected by those who responded to 
the questionnaire 

f ■ The total number of times the response was selected within the school 

■ote: The percentage is calculated according to the number of responses to each question and' 
not the total number of participants. 
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by 97.2% of, the respondents .for "both" and "BVE only." 
A criterion was considered relevant for meeting the stan- 
dard in the event that a minimum of 60% of the responses 
were SA plua A. 

The criterion that the respondents reported as 
being relevant for meeting the standard are as follows: 
(a) the methods of instruction that may be used in order 
for students to meet program objectives are: (a) instruction 

*» 

is varied to accommodate individual learning style of stu- 

s 

dents (94.3%) and students progress at their own rate 
^through a series of tasks (97.7%), (b) the language (s) 
that may be.Aised in the instruction of students are: 
English and target language (,s) (85.7%), (c) the instruc- 
tional staff may be composed of: vocational instructor 

A 

who speaks English and target language (s) (100%), vocational 



instructor who speaks English only and a paraprofessional 
who speaks English and target language (s) (68.6%), vocational 
instructor and a paraprof essioiial who speak English 
and target language (s) (78.8%); vocational instructor 
who speaks only English (63.6%); (d) the evaluation 
methodologies that may be used for the program are: 
a student's performance is compared with a predetermined 
standard (82.9%), a pretest/posttest is given to determine 
individual student's achievement (84.2%); (e) student organi- 
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zation activities are included in the program's instructional 
component (83.3%); and (f) cooperative or on-the-job 

-a- 

instruction is provided for all students when needed (72.22%) 

The criterion that the respondents did not report 

as being relevant for meeting the standard was: the methods 

of instruction that may be used in order for students 

to meet program objectives are: (a) specific period 

Qf time is allocated to each course, or unit and students 

are expected to master th? material within the time . 4 

period (30.3%); (bj the language(s) that may be used 

in the instruction of student* are: English only 

(45.7%) , and target language only (25.0%); (c) the 

instructor who speaks only English (50.0%); (d) the 

evaluation methodology that may be used for the program 

is: a student 9 s performance is compared with that of 

other students (25.00%) and (3) vocational student 

organizations are supported by budgeted school funds 

(52.8%>. , 

The criteria analysis in Table 25 though rejected/ 

were further analyzed in Table 26 by program areas 

which the respondents represented, ESL and BVE. The addi- 

tional analysis of the data showed that: (a) the use f of 

English only for the instruction of the LEP students 

* 

was believed relevant by the ESL staff (77.8%) but not 
by the BVE staff (34.7%); (b) the use of the target 
language only, for the instruction of the LEP students 

158 ' : 



Table 25 

' Instruction Standard and Criteria 



Scale- 



BVE VE BOTH NONE 

CF % , CF % CF % CF 



standard: > * 
Instruction is organized in order to 

assist students in meeting program objectives. . 2 5.6 1 2.8 33 91.7 00 0.0 





Scale 1 


Scale 2 






P SD BOTH PVE 


CF % 


CF % CF , % 


CF % CF % CF % CF % 



Criteria : 

A. The methods of instruction that • < * * ^ 

may be used in order for students 

to meet program objectives are: < * 

(rate all methods) 

(1) Specific period of time is 
allocated to each course or 

unit and students are % 
expected to master the 
material within the time 

period (time based) 0 0.0 10 30.3 2 6.1 15 45.5 6 18.2 10 100.0 0 0.6 

(2) Instruction is varied to 
acconroodate individual 
learning style of ^stu- 
dents (individualized 

instruction) 16 45.7 17 48.6 1 2.9 1 2.9 0 0.0 32 97.0 1 3.0 

(3) Students progress at their 
own rate through a sef ies 
of tasks (competency- 
based) 21 61.8 12 35.3 1 2.9 0 0.0 0 0.0 28 93.3 2 , G.7 
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Table 25 — Continued 



\ 










Scale 1 












Scale 


2 






FT*- 
Dn 




n 


U 






D 






BOTH 


BVE 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


B. The language (s) that may be 






















« 








used in .the ^instruction of 






























students are; (rate all) 








- 












* 

8.6 










(1) English only 


10 


28.6 


6 


17.1 


2 


5.7 


14 


40.0 


3 


13 


92.9 


1 


74 


(2) Target language (s) only 


5 


15.6 


3 


9.4 




3.1 


21 


65,6 


2 


6.3 


5 


62.5 


3 


37.5 


(3) English & target language (s) 


1? 


34.3 


18 


51.4 




0.0 


5 


14.3 


0 


0.0 


19 


63.3 


11 


36.7 


C. the instructional staff may be 






























composed of: (rate all) 












• 










'i 








(1) Vocational instructor who 






























speaks only English 


8 


22.2 


10 


27.8 


U 


U .U 


14 


38.9 


4 


11.1 


1 A 

io 






11 1 


(2) Vocational instructor who 




























speaks English & target 








* 


* 

U 




















language ( s ) 


16 


44.4 


20 


55.6 


U • u 


0 


0.0 


v0 


0.0 
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(3) Vocational' instructor who 






























speaks English only & 






























a paraprofessional who 






























speaks English & target 






























language (s) 


7 


20.0 


17 


48.6 


i 


2.9 


7 


20.0 


3 


8.6 


n 


45.8 


13 


54.2 


(4) Vocational instructor ,6 






























a paraprofessional .who speak 






























. English 6 target langu4|e(?) 


14 


42.4 


12 


36. 4, 


3 


9.1 


2 


6.1 


2 


6.1 


n 


42.3 * 


15 


57.6 


(5) Vocational instructor who 






























speaks English & target 






























language (s) 6 a paraprofes- 






























sional speaking English 






























only 


6 


18.2 


15 


45.5 


2 


6.1 


7 


21.2 


3 


9.1 


li 


52.4 


10 


47. 6, 



* D. The evaluation methodologies that 

may be. used for the program are: £ 

* (rate all) io 

- — " — ■ ■ — — * ■■ — — — ■ ■ — 
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.Table 25 — Continued 



Scale 1 Scale 2 

SA A iT D . SD BOTH bVh 



CF % CF % CF • % CF % a\ « % CF % CF % 

(1) Student's performance is 
compared with that of 

othtfr Students. 1 2.8 8 22.2 3 8.3 17 47.2 7 19.4 8 88.9 1 11„J 

(2) A student's performance 
is compared with a pre- 
determined standard. 6 17.1 23 65.7 5 1-^3 1 2 0 9 0 0.0 27 100.0 0 0.0 

(3, A pretest/posttest is 
given to determine 
individual student 

achievement. 14 36.8 18 47.4 5 13.2 1, 2.6 0 0.0 29 93.,6 2 6.5 

E. Students* organization activities 

are included in the program's f 

instructional component. 4 11.1 26 72.2 4 11.1 2 5.6 0 0.0 29 96.7 1 3.4 

F. The vocational student organ- 
• izations are supported by 

budgeted school funds. 4 11.1 15 41.7 5 13.9 8 22.2 4 11.1 18 94. 8" 1 5.3 

G. ^Cooperative or on-the-job 

instruction is provided for 

all students when needed. 9 25.0 17 47.2 6 16.7 2 5.6 2 5.6 25 96,2 1 3-9 

Scale: see next page 
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Table 25 Scale: 

BVE - The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE * The standard is appropriate only for students enrolled in traditional Vocational Education 

(the language of communication is English only) 
Both » The identified standard is equally relevant to BVE and VE program , 
None « The standard is not necessary for an effect BVE and/or VE program 

SA = Strongly Agree that the criterion described would have considerable impact in meeting 

the standard in an effective BVE pronram 
A » Agree that the criterion described would have a moderate impact in meeting the standard in 

an effective BVE program 
U « Undecided that the criterion described would have any impact in meeting the standard in 

an effective BVE program 
D m Disagree that the criterion described would have any impact in meeting the standard in 

an effective BVE program 
SD = Strongly Disagree that the criterion described would have any impact in meeting the 

standard in an effective BVE program 
CF = The total nurrihor of times that response was selected by ail the respondents 
% » Percentage of the total time that response was selected by those who responded to the 

questionnaire 

f * The total ftumber of times the response was selected within the school 

Note: The peicentage is calculated according to the number of responses to each question and 
pot ti>e total number of participants. 
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Table 26 

Instruction Standard and Criteria by Type of Instructor 



SA 



D 



ERLC 



CF 



CF 



CF 



CF 



Standard: 

Instruction is organized In 
order to assist students in 
meeting program objectives 

Criteria: 

B. The language (e) that may be 
used in the instruction cf 



The evaluation methodolo- 
gies that may be used for 
the program are : 
(1) A student's performance 
is compared with that 
of other students 
(norm-reference) 

The vocational student 
organizations arc supported 
by budgeted school funds 



ESL 
BVE 

ESL 
BVE 



1 

0 

2 
2 



11.1 
0.0 

22.2 
7.4 



1 

7 

6 
9 



11.1 
25.9 

66. 6 
33.3 



3 
0 

1 
4 



33.3 
0.0 

11.1 
14.8 



4 

13 

0 
8 



44, 
48 



0.0 
29. G 



Scale: see next page 
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CF 



students ares 


ESL 


5 


55.6 


2 


22.2 


1 


11.1 


1 


11.1 


0 


0.0 


(1) English only 


BVE 


5 


19.2. 


4 


15.4 


1 


3.9 


13 


50.0 


3 


11. (l 


(2) Target language (s) 


ESL 


1 


11.1 


2 


22.2 


0 


0.0 


3 


33.3 


3 


33.3 


only 


BVE 


4 


15.0 


1 


4.0 


1 


4.0 


18 


69.0 


2 


8.0 


The instructional staff may 
























be composed of: 






















.t 


(1) Vocational instructor 
























who speaks only 


ESL 


4 


44.4 


3 


33.3 


0 


0.0 


2 


22.2 


0 


0.0 


English 


BVE 


4 


14.8 


7 


25.9 


0 


0.0 


12 


44.4 


4 


14.6 



0 
7 

0 
4 



0.0 
25.9 

14.8»o 
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fable 26 Scale: 

ESL * Staff of English as a Second Language instruction 

BVE * Staff of Vocational Programs with LEP students enrolled 

SA * Strongly Agree that the criterion described would have a considerable impact in meeting 

the standard in an effective BVE program / 
A » Agree that the criterion described would have a moderate impact in meeting the standard 

in an effective BVE program 
U * Undecided that the criterion described would have any impact in meeting the standard 

in an effective BVE program 
D * Disagree that the criterion described would have any impact in meeting the standard 

in an effective BVE program 
SO * Strongly Disagree that the criterion described would have any impact in meeting the 

standard in an effective BVE program 
CP « The total number of times that response was selected by the respondents 
% » Percentage of the total time that response was selected by those who responed to the 

questionnaire - 

Notes: The numbers and letters are concurrent with those used in the previous table and in the 
questionnaire. 

The percentage is calculated according to the total responses to the question and not 
the number of participants. 
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was rejected Ly both groups: (c) a vocational instructor 
who speaks English only was believed relevant by the ESL 
staff (^7.8%) but not the BVE staff (40.7%); (d) the 
evaluation of students by comparing their performance vith 
that of other students in the class was rejected by both 
groups; and (e) the support of vocational student organiza- 
tions by school budgeted funds was believed relevant by the 
-ESL staff (88.9%) but not the BVE staff (40.7%). 

» 

Student Job Placement Standard 
and Criteria 

The standard "Placement services are provided to 
program completers and/or leavers' 1 was believed appropriate 
to "both" by 91.4% of the respondents as shown in Table 27. 
The criteria that yere identified as relevant for the 
standard above were: (a)^th£ placement of students is the 
responsibility of the occupational specialist (69.0%) and 
the student (86.1%), (b) the placement of students who con- 
plete or leave the program is j further assisted by the fol- 
lowing agenfcies: Florida State Employment Services (94-4%)/ 

potential employers in business and industry (88.9%), and 

% 

ethnic group organizations (63.9%)/ (c) aid for placement is 
provided for: males (91.7%)/ females (91.7%) , member minority 
ethnic group (86.1%)/ minority race member (86.1%) , LEP 
(80.0%)/ and handicapped (88.6%). The further analysis of 
data showed that the respondents believed tht these criteria 
were pertinent for "both 11 by a minimum of 73.1% of the 
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Table 27 

Student Placement Standard and Criteria 



Scale 



BVE. _2E BOTH NANS 

CF % CF % CF % CF 



Standard: 

Placement services are provided to 

program completers and/or leaders 25. 70 0.0 32 91. 4 3 8.6 



Scale 1 Scale 2 



SA A U D SD BOTH BVE 



CF % CF % CF % CF % CF % CF % 5 CF 



Criteria: 

A. The placement of students is 
the responsibility of: 
(rate all) * 



(1) 


Vocational instructor 


5 


13.9 


10 


27.8 


3 


8.3 


14 


38.9 


4 


11.1 


14 


93.3 


1 


6.7 


(2) 


Cooperative education 
































instructor 


4 


10.8 


14 


37.8 


2 


5.4 


13 


35.1 


4 


10.8 


17 


94.4 


1 


5.6 


(3) 


Guidance . counselor 


4 


11.1 


15 


41.7 


3 


8.3 


10* 


27.8 


4 


11.1 


18 


94.7 


1 


5.3 


(4) 


Occupational specialist 
































(high school only) 


9 


25.0 


16 


44.4 


1 


2.8 


8 


22.2 


2 


5.6 


24 


96.0 


1 


4.0 


(5) 


Student 


6 


16.7 


25 


69.4 


0 


0.0 


4 


11.1 


1 


2.8 


27 


93.0 


2 


6.0 


(6) 


Director 


1 


2.8 


6 


16.7 


3 


8.3 


20 


55.6 


6 


16.7 


7 


10U.0 


0 


0.0 



B. The placement of students 
who complete or leave the 
program is further assisted 
by the following agencies: 
(rate all) 

(1) Florida State Employment bo 
Services 7 19.4 27 75.0 0 0.0 0* 0.0 2 5.6 32 94-1 2 5.9 
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Table 27 — Continued 



c 










Scale 1 








1 




Scale 


2 




SA- • 




A 




U 




s 






BOTH 
CF % 


BYE 




CF 


% 


CF 


% 


CF 


% 


CF 


% 


Cf 


% 


CF 


% 


(2) Advisory Committee members 


3 


8.3 


14 


38.9 


2 


5.6 


14 


3$. 9 


3 


8.3 


1 15 


93.8 


1 


6.3 


(3) Potential employers in 
















i 










* 




business dhd industry 


6 


16.7 


26 


72.2 


4 


114 


00 


ob.o 


0 


0.0 


1 30 


93.8 


2 


6.j 


(4) Ethnic group organizations 


3 


8.3 


20 


55.6 


8 


22.2 


2 


5.6 


3 


8.3 


21 


95.5 


1 


4.6 


- 

C* Aid for placement is provided 
















j 

I 














for program leavers and 
















i 














i completers 
















I 














\xi Am is pro viae a ror (race 
















I 














all): y 
















j 














(a) Males 


11 


30.6 


22 


61.1 


6 


0.0 


2 


I 5.6 


1 


2.8 


32 


97.0 


1 


3.6 


(b) Females 


11 


30.6 


22 


61.1 


0 


0.0 


. 1 


' 2.8 


2 


5.6 


31 


96.9 


1 


3.1 


(c) Member minority 






























ethnic group . 


11 


30.6 


20 


55.6 


1 


2.8 


1, 


5.6 


2 


5.6. 


30 


96.8 


1 


3.2 


(u) Minority race member 


11 


30.6 


17 


48.5 


3 


8.6 


3 


8.6 


1 


2.9 


22 


95.7 


1 


4.3 


(e) Limited English speaking 


11 


31.4 


X 1 


48.5 


3 


. 8.6 


3 


8.6 


1 


2.9 


22 


78.5 


6 


21.4 


(f) Handicapped 


11 


31.4 


20 


57.1 


1 


2.9 


i 


5.7 


1 


2.9 


30 


96.8 


1 


3.2 



Organized experience in the 
labor market is provided to 
meet program objectives (Work 
Experience Program) 

(1) Parent and employer train- 
ing agreements are avail- 
able for each student 

(2) All students in program work 

(3) The program operates in 
accordance with state & 
federal labor laws 



2 6.1 15 45.6 12 36.4 / > 6.1 
2 6.1 12 36.4 9 27.3 8 27.3 



2 6.1 17 \ 94.4 
2 6.1 13 ,92.9 



8 24.2 20 60.6 3 9.1 2 6.1 0 f.O 27 96.4 



5.6 
7.1 



3.6 
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Table 27 — Continued 



Scale 1 . Scale 2 

Jf D 7 | SD ' ROTl f BVE 



CF % CF % CF % CF %« CF % CF . % CF 



(4) 


Student assignment^ to 
employment situations ar*e 












• 




















without bias towards: 




















4 












(Work Experience Program) 




























.4 


(a) Males 


11 


33.3 


Id 


57.6 




9.1 


0 


0.0 


0 


0.0 


28 


96.6 


1 


<3.5 




(b) Females 


11 


34.4 


18 


56.3 


3 


9.4 


o • 


0.0 


0 


0.0 


28 


96.6 


1 


3.5 




(c) Ethnic group 4 


12 


36.4 


18 


54.6' 


'3 


9.1 


0 


0.0 


0 


0.0 


27 


96.4 


1 


3.5 




(d) Race 4 


11 


33.3 


19 


57.6 


3 


9.1 


0 


0.0 


0 


0.0 


28 


ioo.o 


0 


0.0 




(e) Limited English speak- 






4 






















26.9 




ing ability c 


10 


31.3 


16 


50.0 


6 


18.8 


• 0 


o.q 


0 


0.0 


19 


73.1 


7 




(f) Handicapped 


1 


100.0 


0 


100.0 


o' 


0.0 


0 


0.0 


0 


0.0 


1 


100. 0 


0 


0.0 


(5) 


Student progress folders are 












6'. 5 




















available to placement staff 


7 


22/6 


20 




2 


1 


3.2 


1 


3.2 


25 


10Q.0 


0 


0.0 


(0) 


Student placement foldelrs are 














i 
















available to placement staff 


10 


30.3 


20 


60.6 


2 


6.1 


0 


0.0 


1 


3.0 


25 


100.0 


0 


0.0 



Scale: 

BVE * The standard is appropriate only for students enrolled in Bilingual Vocational Education 
, VE * The standard is appropriate only fcqr students^enrolled in traditional vocational Education 

(the language of communication is English only) 
u Both * The identified standard is equally relevant to BVE and BE programs * 
None « The standard is not necessary for an effective BVE and/or VE program * 

SA m Strongly Agree that the criterion described would have considerable impact in meeting the 

standard in an effective BVE program 
A * Agree that the criterion described would have a moderate impact in meeting the standard in 

an effective BVE program H 
U « Undecided that the criterion described would have any impact in meeting the standard in £ 

an effective BVE program 

17,; , l?-J 



Table 27 Scale: (continued) 

— - ' ^?^ t ^^ ion - de8Cribed "° uld have any impact in ^ the 

SD " a m^e^e^ described wouid have any impact *• 

C l ' ZJ^LT e h °f "r S , ti,at rei -° nSe " aS Sel6Cted b * * 11 respondents 

S^SoiiS tlme that re8P ° nSe WaS SeleCted ° y th ° Se Wh ° '"I— to 

f - The total number of times the response was selected within the school 

N ° teS S3 ^l C T a t\^ Calculated according to the number of responses to each question 
and not the total number of participants. question 



responses. 

The criterion or its components that were not rated 
as being relevant for the standard by the respondents were 
further analyzed, as shown in Table 28, in reference co the 
types of programs the representatives participated in ESL and 
BVE. The analysis of the data showed the following: 
(a) the placement; of students is the responsibility of the 
vocational instructor was rejected by both groups; coopera- 
tive education instructor was believed relevant by the ESL 
staff (60.0%) but not the BVE staff (44.4%); guidance coun- 
selor was xound relevant by the ES T < staff (66.7%) but not 
the BVE ^taff (44.4%); and the program director was not 
found relevant by either group; (b) the placement of students 
who complete or leave the program is further assisted 
by the following agencies: advisory committee members , * 
who were believed to be relevant by the ESL staff (88.8%) 
but not the BVF staff (33.2%). 

Student Placement Standard and 
Criteria for "Work Experience 
Programs 11 

The standard "Placement services are provided to 
program completers and/or leavers" was employed by the 
State of Florida, "Work Experience Instructional Program 
Review Model" » .d not rated separately during this study. 
The standard was validated during this study by the 
respondents, for student placement in reference to "BVE ancL_„ 
both." The respondents were requested to express their 
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belief as to the relevance of the criteria for meeting the 
standard. « 

The criteria, shown in Table 28, were identified 
as necessary for meeting the standard for student pr ace- 
men t for "Work Experience Programs" when a minimum of 60% 
of the responses for the criterion components were SA plus A. 

The relevant criteria for meeting the standard 
for work experietv programs were: (a) organized experi- 
ence in the labor market is provided to meet program 
objectives, the program operates in accordance with state and 
federal labor laws (84.9%); (b) students assignments to 
employment stations are without bias towards: male (90.9%), 
females (90.6%), ethnic group (90.9%), race (90.9%), and 
LEP (81.3%); (c) students progress folders are available to 
placement staff (100%); students placement folders are 
available to placement staff (90.9%) • 

The criteria rejected by the initial analysis of 
data were further analyzed in reference to the program areas 
represented by the participants, ESL and J3VE. The analysis 
of the rejected criteria, shown Table 28, for "Work 
Experience Programs" showed the following: (a) organised 
experience in the labor market is provided to meet program 
objectives; parent and employer training agreements art* 
available for each student was believed relevant by 100% 
of the ESL staff and only '36% of the hVE staff; and all 
students in program work was believed relevant for 'die 

17J . • 



Table 28 

Student Job Placement Standard and Criteria by Type of Instructor 



SA 



CF 



CF 



CF 



SD 



CF 



CF 



Standard : 

Placement services are provided 
to program completers and/or 
leavers 

A. The placement of students is 
the responsibility of: 

(1) Vocational instructor 

(2) Cooperative education 
instructor 

(6) Director 

8. The placement of students 
who complete or leave the 
program is further assisted 
by the following agencies: 
(2) Advisory Committee 
members 

D. organized experience in the 
labor marke is provided to 
meet program objectives (Work 
Experience Program) 

(1) Parent and employer 
training agreements 
are available for each 
student 

(2) All students in program 
work 



ESL 


2 


22.2 


2 


22 2 


0 


0.0 


5 


55.5 


0 


O.Oi 


BVE 


3 


11.1 


B 


29.6 


3 


11.1 


9 


33.3 


4 


14.8 


ESL 


2 


20.0 


4 


40.0 


1 


10.0 


3 


30.0 


0 


0.0 


BVE 


2 


7.4 


10 


37.0 


1 


3.7 


10 


37.0 


4 


14.8 


ESL 


1 


11.1 


3 


33.3 


0 


0.0 


5 


5l>.5 


0 


0.0 


BVE 


0 


0.0 


3 


11.1 


3 


11.1 


15 


55.5 


6 


22.2 


ESL 


2 


22.2 


6 


66.6 


1 


11.1 


0 


0,0 


0 


0.0 


BVE 


1 


3.7 


8 


29.6 


1 


3.7 


14 


51.8 


3 


11.1 



ESL 


2 


25.0* 


6 


75.0 


0 


0.0 


0 


o.n 


0 


0.0 m 
8.0 t 


BVE 


0 


0.0 


9 


36.0 


12 


48.0 


2 


8.0 


2 


ESL 


1 


12.5 


6 


75.0 


. 0 


0.0 




12.5 


0 


0.0 


BVE 


1 


4.C 


6 


24.0 


9 


36.0 


1 


28.0 


2 


8.0 
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see next page 
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Table 28 Scale: 

ESL ■ Staff of English as a Second Language instruction 

BVE • Staff of Vocational Programs with LEP students enrolled 

SA » Strongly $gree that tbT criterion described would have a considerable impact in meeting the 

standard in an effective Bve program 
A m Agree that the criterion described would have a moderate impact in meetino the standard in 

an effective BVE program 
U ■ Undecided that the criterion described would have any impact in meeting the standard i-n 

an effective BVE program 
D « Disagree that the criterion described would have any impact in meeting the standard in 

an effective BVE program 

SD m strongly Disagree that the criterion described would have any impact in meeting the stan- 
dard in an effective BVE pre gram * 

CF ■ The total number of times th^t response was selected by the respondents 
t * Percentage of the total time ihat response was seleated by those who responded to the 
questionnaire 

Notes: The numbers and letters are concurrent with those used in the previous table and in the 
questionnaire. 

The percentage is calculated according to the total responses to the question and not 
the number of participants. 
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standard *>y^ 87. 5% of the ESL staff and only _28^0% of the BVE 
staff. The analyses of the data from the participants' 
responses showed the criteria were relevant for "both" 
types of programs. 

/ 

Student Follow-up Standard / 
and Criteria ' 

The standard "Data from follow-up studies are used to 

t 

make decisions regarding curriculum and program revision" was 
believed appropriate by 86.1% of the respondents as shown in 
Table 29. Appropriate here is defined as a response of at 
least 60% from the participants for M both w and/or "BVE only." 

'The criterion was considered relevant for meeting the 
standard if 60% or better of the respondents selected SA plus 
A. The criteria also shown in Table 29, that were identified 
by the respondents as relevant in meeting the standard were; 
(a) students are informed of the importance of follow-up 
studies (91.4%), (b) students are informed of folhow-up pro- 
cedures (91.4%), (c) teachers/instructors receive) placement 
J and follow-up information each year for the/ purpofee of: 

making program changes (80.0%); sharing with school/college 

i 

administrators (70,3%); sharing with Board of trustees (61.3%); 
sharing with advisory committee (65.71%); sharing with 
students currently enrolled in the program (65.7%); and 
(d) teachers assist in contacting former students (77.1%). 
These criteria that were believed relevant for meeting the 



9 
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standard were additionally believed by the respondents to be 
pertinent to "both" with a minimum response of 93.3%. 

184 



Table 29 

Student Follow-up Standard and Criteria 



Scale 



BVE 



VE 



CF 



CF 



BOTH 
CF 



NONE 
CF 



Standard : 

Data from follow-up studies are used 
to make decisions regarding curriculum 



ana program revision 












4 


1 1 

X 1 


1 

• X 


1 


2.8 


31 


86.1 


00 


0.0 










Scale 














Scale 


2 




SA 




A 


U 


( 


D 




SD 


BOTH 


BVE 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% 


CF 


% CF 


% 


Criteria: 






























A* Students are informed of the 






























importance of follow-up 






























studies 


7 


20.0 


25 


71.4 


1 


2.9 


2 


5.7 


0 


0.0 


28 


93.3 


2 


6.7 


B. Students are informed of follow- 






























up procedures 


7 


20.0 


25 


71.4 


1 


2.9 


2 


5.7 


0 


0.0 


29 


93.5 


2 


6.5 


C. Teachers/instructors receive 






























placement & follow-up infor- 




























r 


mation each year for the pur- 




























pose of (rate all) : 






























(1) Making program changes 


5 


11.9 


22 


61.1 


2 


5.6 


4 


11.1 


3 


8.3 


25 


96.2 


1 


3.9 


(2) Sharing with school/ 






























college administrators 


5 


13.6 


21 


56.8 


6 


16.2 


2 


5.4 


3 


8.1 


24 


96.0 


1 


4.0 


(3) Sharing with Board of 






























Trustees (C.C. level only) 


4 


12.1 


15 


45.4 


12 


36.4 


0 


0.0 


2 


6.5 


16 


94.1 


1 




(4) Sharing with Advisory 






























Committee 


5 


14.3 


18 


lt.4 


10 


2d. 6 


0 


0.0 


2 


5.7 


21 


100.0 


0 


0,0 



Scale: see next page 



ERJC 135 



18G 



Table 29 Scale: 

BVE » The standard is appropriate only for students enrolled in Bilingual Vocational Education 
VE * The standard is appropriate only for students enrolled in traditional Vocational Education 

- — (the language of communication is English only) , 
Both ■ The identified standard is equally relevant to BVE and VE programs 
None ■ The standard is not necessary for an effective BVE and/or VE program . 

SA » Strongly Agree that the criterion described would have considerable impaqt in meeting tfie 

standard in an effective BVE program 
A ■ Agree that the criteribn described would have a moderate, impact in meeting the standard 

in an effective BVE program v 
U = Undecided that the criterion described would have any impact in meeting the standard in 

an effective BVE program 
D * Disagree that the criterion described would have any impact in meeting the standard in 

an effective BVE program 
SD ■ Strongly Disagree that the criterion described would have any impact in meeting the 

standard in an effective BVE program 
CF = The total number of times that response was selected by all the respondents 
% * Percentage of the total time that response was selected by those wbo responded to the 

questionnaire 

f * The total number of times the response was selected within the school 

Note: The percentage Is calculated according to the number of responses to each question am: not 
the total number of participants* 
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Staff Improvement: Standard 
and Criteria 

The standard "The opportunity for professional 
improvement is provided in accordance with staff needs/' 
was believed appropriate by 88.9% of the , respondents 
as presented in Table 30. A standard required pnly a 
response of 60% of the participants to be identified as 
appropriate. The criteria necessary for meeting the 
standard were identified in that a minimum of 60% 
responses were SA and A. 

The criteria (see Table 30) necessary^to meet 

the above standards were: (a) the staff development 

needs of those responsible for the program are assessed 

t 

in the following areas cultural understanding 
(82.4%); vocational update (100.0%); foreign 
language skills (68.6%); English language skills 
(80.0%); (b) xnservice staff development workshops are 
provided (94.4%); (c) inservice administrative "develop- 
ment workshops are provided (83.3%); and (d) local fyhds 
ere provided for travel to self-development activities 
(69.4%). The criteria that the respondents identified 
as relevant for meeting the standard were additionally 
believed to be pertinent to '•both'' types of programs with 
a minimum response^ of 87.5 %. 
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Table 30 

Staff Improvement Standard and Criteria 



Spale 



BVE « VE BOTH NONE 



CF % CF % CF % CF % 



Standard: 

^^The opportunity for professional improvement ' 
is provided in accordance with Staff needs 



4 11.1 0 0.0 32 88.9 0 



SA 



CF 



Criteria: ^ 

A. The staff development needs 
• those responsible for the 

program are asse^ in the 
following areas ;e all) 

(1) cultural und' .anding 

(2) vocational upu te 

(3) foreign language skills 

(4) English language" skills 

(5) Other' (specify) 

B. Inservice staff development 
workshops are provided 

C. Inservice administrative 
development workshops are 
provided 

D± Local funds are provided for 
travel to self-developmer t 
activities 9 



Scale: see tiext page 
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Scale 1 



.Scale 2 



u 



CF 



SD 



•BOTH . 



QF_ 



CF 



CF 



CF* 



BVE 
CF 



9 


26.5 


19 


55.9 


6 


17.7 


0 


f 0.0 


0 


0.0 


17 


100. 0 


0. 0.0 


10 


28.6 


25 


71.4 


0 


o.o; 


0 


0.0 


p 


0.0 


0 


0.0 


0 0.0 


4 


11.4 


20 


57.1 


6 


i7a 


5 


14.3 . 


0 


0.0 


21 


87.5 


3 J2 V .5 


6 


17.1 


22 


62.9 


7 


20.0 


. 0 


0.0 


0 


0.0 


27 


100.0 


o 4 0.0 


8 


22.2 




72.2 


" 2 


5.6 


0 


» 

0.0 


0 


0.0 


30 


75.0 


2 5.3 


9 


25.0 


21 


58.3 


6 


16/7 


0 


0.0 


■> 0 


0.0 


27 


1 96.4 ' 


1 3.6 



25.0 16 44.5 



3 8.3 b 13.9 



3 8.3 24 96.0 1 ' 4.0 o 
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Tablp 30 Sca*i||^ ^ 

BVE = The staftdard is appropriate only for students Enrolled in Bilingual' Vocational Education 
VE = The standard is appropriate only for students enrolled in traditional Vocational Education 

{The language of communication is English only} 1 ^. ' 

Both * The identified standard is'.equally relevant to V BVE and* VE programs 
None » -The standard is not necessar J for an effective BVE and/or VE program 

SA = Strongly'Agree that the criterion- described would have Considerable-impact tn meeting "the. 

standard in &n effective BVE program , 
A = Agree that the criterion 8escribed would have a moderate impact in meeting Aie standard in 

an effective BVE program * # v 

U = Undecided that the criterion described would have any intact in meeting the standard in 

an effective BVE program » 
D = Disagree that tiie criterion described would have any 'impact in meeting the standard in ' 

an £ffe<?tive BVE program^ , 
SD .= Strongly Disagree that the*cr iterion described would havtf any impact in meeting the 

s-^Mard in an effective BVE program 
CF " ' ' tai number of times th^t response was selected by all the* respondents 
% = age of th« tot?l time that response was selected by those who' responded to the 

c onnaire 

f s T, « number of times. the response was selected within the school 



: The percentage is calculated according to, the number of responses to each quest ion'/nd not 
the total number of participants. 



14 2: 

Administratqr-s and Supervises 

Standard and Criteria , * 

The standard "Administrators and/or supervisors 
provide assistance .in program maintenance 'and improve- 
ment, was believed appropriate by 82„0T% of the respondents 
as shown in Table 31. A minimum of 60% responses was 
required for the standard to be 'identified as "appropriate. " 
The criteria necessary for meeting the above stated 
standard were identified when a minimum of 60% of the 
responses for the_x4iterioa or its components was SA 
plus A. * "\ 

The criteria identified as relevant to the avove # 
standard were: (a) the administrators and/or supervisors 
who provide assistance: dean Of instruction (67*7%); 



dean/director of occupational education; program leader; 
local director of VE; county level vocational supervisor; 
school principal or director. The previously identified 
^riteria for the above standard were additionally perceived 
as pertinent for % "fcoth" by a minimum of 95.i> of the 
respondents. 



\ 
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Table 31 . ' 
Administrators and Supervisors Standard afid Criteria 



Scale 

* BVE VE _MU 'NONE 

CF % CF . % CF % CF 



Standard: ' f 

Administrators and/or supervisors provide assistance 

in program maintenance and improvement. 7 18.0 0 0 32 82.0 0 
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Scale 1 
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Seal 




SA 


A - 




U 
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. SD 


BOTrf ' 


RVR- 


CF \ 


CF 




.CF 
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CF 


% 


CF 


^ % 


CF % 


CF % 


5 14.7 


18 


52.9 


10 


29.4 
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2.9 
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0.0 


22- 95.7 
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1- 4.4 


* 5 14.7 


22 


64.7 
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20.6 
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0.0 
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0.0 


26- 96.3 


1 3.7 


5 14.7 


20 


58.8 
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26.5 
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0.0 


0 


0.0 


17 100.0 


0 0.0 


5 14.7 


23 


67.7 


6 


17.7 
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• 0.0 


0 


0.0 


26 9*6.3 


1 3.7 


6 ' 17.7 


23 


67.7 


5 


14.7 


0 


0.0 


0 


0.0 


28 <M.3 


2 6.7 



Criteria: - 

A. The administrators and/or super- 
visors who provide the assistance 
are: (rate all) 

(1J Dean of Instruction (C.C. only) 

(2) Dean/Director of Occupational 
Education (C.C. only) 

(3) Program ^Leader (C.C. 6nly) 

(4) Local Director of VE (high 
school only) 

# (5) County level Vocational Super- 
visor (high school only) 
(6) School Principal or Director / 

(high school only) 6 18.2 25 75.8 2 6.1 v 0 0.0 0 0.0 30 100.0 0 0.0 
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Table 31 — Continued 



• 










Scale 1 








Scale 


2 






SA 




A 


U 




D • 


SD 


BOTH 


BVE , 




CF 


% 


CF 


% 


CF % 


CF 


' % 


CF % 


CF % 


CF . % ' 


(•5) Sharing with students 
< currently enrolled in 
the program 


5 


14 


;3^18 


51.4 


10 28.8 s 


*0 


0.0 


» 

2 5.7 


X 

21 100.0 


0 6.0 


D. Teachers assist in contacting 
former students 


4, 


11 


.4 23 


65.7 


5 14.3 


1 


2.9 


2 5.7 


21 100.0 


0 0.0 



Scale: 

BVE » The standard is appropriate only for students enrol ed in Bilingual Vocational Education 
VE "The standard is appropriate only for students enrolled in traditional vocational Education 

(the language of communication is English only) 
Both » The identified standard If equally relevant to BVE and VE programs 
None « The standard IV not necessary for an ef feqtive BVE and/or VE program 

SA ±*Str9ngly Agree that the criterion described would have considerable- impact in meeting* the 
standard in an -effective BVE program 
» Agree that the criterion described would have a moderate impace In meeting the standard in 

an effective BVE program 
» Undecided that the criterion described would haVS any impact in meeting the standard in » 
an effective BVE program 

* Disagree that the criterion described would have any impact in meeting the standard in 
an effective BVE program* 

« Strongly Disagree that the criterion described would have any impact in meeting the standard 
in an effective BVE program » 

* The total number of times that, response was selected by all the respondents 
- Percentage of the total time that response was selected by those who responded to the 

questionnaire ^ 
f « The' total number o$ times the response was selected Vithin the schooi 

Note: The percentage is calculated according to the number of responses to each question and not the" 
total number of participants. 
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n 

1} 

D 

SD 
% 
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BVIPRC Development and Pilot 
Test 

The BVIPRO-vas developed on the basis of the 
analysis of the data obtained from" the questionnaire 
(QIV) and the structural format mandated by the State 
of Florida ^ Division of Vocational Education t Bureau of 
Vocational Research, Dissemination and Evaluation. The 
specified format^was the same as that employed in the 
VEIPR f.or the state. The VEIPR was a process model o£> 
which the procedures are composed of a self -evaluation 
. section, an on-site review verification by a consultant, 
and conference with consultant l and v the school administra- 
tor to discuss the outcome of the!* program review. The 
program instructed is involved only in the self-evaluatiorf 
and .on-site visit- of the consultant. Likewise, the BVIPRC 
i* 'composed* of a self-evaluation component" and an on-site * 
review. The conference with administrators, however, 
was heid only with those supervisors who deiired feedback. 

To obtain a" better understanding of the methodology 
employed during a program review the researcher accompanied 
a program consultant during the program review at a 

D 

vocational technical center. "The consultant also critiqued 
the" BVIPRC (CII) for reliability of interpretation, 
^clarity of wording, and validity of content. ' 
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The BVIPRC was -reviewed by the panel of experts 
and revised^ based on their recommendations and the 

consultant* The revisions were as follows: (a) the 

I 

letters th^t were to be sent with the self -evaluation 

9 H 

form to th<* instructors and administrators were revised 



to include 



English its a Second Language Programs (see 



Appendix E ) , (To) the "evidences -for standards" portion 
of the 'Direction Bootf* wete increased from the VEIPR, for 
traditional VE, to include specific "evidence) for stan- 
dards for the BVE programs" (see Appendix fe), (c) the 
, criterion, "t5e membership of the advisory committee is 

\ 

representative of" was increased to include subject^ master 
experts and the handicapped $ (d) the criterion "the program 
' is staffed by qualified teachers/instructional personnel 
were increased to include subject matter experts, 
handicapped, and Bilingual English as a Second Language 
Instructor, (e) thje word "regular" was changed to "stan- 
dard" in reference to the teacher V.E. certification 
acceptable for validation of qualifications* (f) Vhe 
area he'ading "VII" was ghanged to read "Recruitment and 
Orientation Procedures are operations" rather than 

"Recruitment Procedures are Operational - n (g) the criterion 

«■ 

"Orientation sessions are held to acquaxnt students with 

m 

program was increased to include guidance Personnel, 
(h) the criterion community resources that are use&'t. 4 
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"Social Organization" was increased to include outreach 
recruitment staff, (i) the criterion for class enrollment 
wafJ^ reworded in a positive way to concur with the new 
wording that was being introduced to^the VEIPR. Th^ f 
revised criterion appears as "The number of students 
enrolled in the class permits the students to .attain 
program objectives "> the response to the criterion 
"Wfiat is the predominant method of instruction" was changed 
from "check one" to "check all. that apply", (k) the 
criterion "The placement of Students is the responsibility^ 
of: the "CtDopeirative education, instructor" was changed* 
to "Cooperative education coordinator", "student" was 
^changed to read "student himself /herself"/ "director" was * 
changed to! read "Director/Principal" and County Super-^ 
visor was added to the selection of persons who provide 
placement assistance, (1) the criterion "sharing with 
ochool /college administrators" for the use of followr-up 
studies was changed * to "discuss with", (m) the criterion 
foV supervisory and ^administrators who provide assistance 
pas changed to include Assistant Principals, arid (n) the 
critefioh "Local funds are provided for travel to » 
'self-developing 1 activities" was changed to reAd "-Local 

0 

funds are provided for travel to staff for self -improvement 
activities" (see Appendix E for pilot test BVIPRC ) . 

* 

■> 
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Upon the completion of instrument revisions, the 
BVIPRC (CHI) was pilot tested , on the 'previously iden- 

tified staffs that responded to the questionnaire. 

/ 

These were instructors of LEP studerits enrolled in voca- 

/ 

tional programs: The pilot test ponsisted of the self- 

evaluation that the participants completed prior to the 

.-isit by tfre researcher for the on-site teview. The 

on-site review included an interview with ich participant 

for the ^purpose of determining the reliability of the 

interpretation of the instrument and validity of tfrd 

» 

standards and their criteria (see Table 32) . 

The researched reviewed the self -evaluation form * 
tp identify areas of discrepancy between the observed 
and recorded data. The participant (s) and the researcher 
then reviewed the instrument for further verification of 
interpretation and validation of standards^ The researcher 
recorded the area that each criterion (BVE, *ESL# both* 
none) was perceived by the participants to be 
most relevant for the .criteria. Table 3 2 shows that the 
•criteria were revalidated by the participants as relevant 
for both and BVE only by 60% or more of the responses 
for each criterion. .In addition, it was* found that the 
instructors believed that the same criteria could be. 
used for all students (both LEP and English speaking) 
except the use of target language for instructors. A 
minimum of 60% of the responses to be considered was 
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Table 32 



Bilingual Vocational Instructional Program Review Component Validation of Criteria 
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2 (continued) 
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Table ^2 (continued) 
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Table 32 (continued) 
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Table 32 (continued) 
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Tablq 32 (continued) 
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Table 32 (continued) 
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/Table 32 (continued) 
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necessary for "both" and/or "BVE only" for the criteria 
to be perceived by the researcher as being relevant to 
BVE. - . . ' * 

vvjhe BVIPRC (CIII) was further critiqued* by several 
•of the staff at the Bureau of Vocational Research , 
Dissemination and Evaluation. Their recommendations were 
incorporated into the field test version of the BVIPRC 
(CIV) . The review by the panel of experts and the staff 
of the Bureau G of Vocational Research, Dissemination and 0 
Evaluation' did hot provide data for analyses, their in put 
vrns for structure and content. The suggestions of the review 
'ers were incorporated into the field test model of the BVIPRC .' 
The BVIPRC was developed by ,the researcher , 
deleting those criteria wh'idh, though found valid by the 
questionnaire analysis and revalidation (the pilot test 
analysis)^ were not, desired by the state personnel. 
An* example of such a deletion includes the use of pretest/ 
posttest as a method of student evaluation. The 
areas found to require rewordirg for clarity of 
interpretation were revised as was thfe' introduction of 
an. instruction page at the beginning of the self-evaluation 
form (see Appendix E). The original direction booklet 
was identified as a BVIPRC Information Book ; it contains 
the definitions and purpose of the program review (see 
Appendix E ) • 
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The BVIPRC (CIlTPVas thaiv reviewed by the panel ^ 
of % experts and revised as needed. In addition, the 
researcher developed an evaluation instrument, for the 
purpose of the, participant evaluating the BVIPRC (CIV). 
The BVIPRC (CIV) evaluation instrument was reviewed by 
the panel of experts and revised as needed. The purpose 
of the BVIPRC evaluation was to provicfte the participants 
with the opportunity to express their beliefs as to whether 
or not the purpose of program review, as identified by 
the State of Florida, was being accomplished. It further 
provided the respondents with a chance to express their 
beliefs as -to the clarity of the instrument and validity 
of contents. 



Tield Test BVIPRC 

The field test was administered to a new group of 
straff members that had been identified by the researcher . 
during the pilot test of the -BVIPRC by process of chaining. 
The new participants in the study were administrators 
and teachers in vocational programs with LEP students 
enrolled. This new group provided for a final review of 
the •reliability of interpretation of the BVIPRC (CIV) 
and the validity of its standards and thair criteria for 
BVE. „ /?v 

The procedure followed for the field test of the 
BVIPRC (CIV) was: (a) the participant's completion of 



/ 



\ 
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the s^lf -evaluation form and, the evaluation .fqrm for 
the component , and (b) the on-site visit of the researcher 
for the purpose of reviewing the self-evaluation responses 
witl^the participant (s) and determining the reliability 
of the interpretation of the BVIPRC (CIV) . The participant- 
researcher irit^rviews also provided the respondents, with 
an opportunity to' express their beliefs as to the methods 
that could be used to improve the,, program review methodo- 
. ' logy (see Appendix F) . ' 

%ome of the teachers' /administrators 9 suggestions 

* w * - »» 

provided during the on-site visit of the researcher were: (a) 

'the use of a process ♦evaluation component to the BVIPRC 
that would include ^the participation of the students. The 
students would be evaluated for the skills that they were 
reported to have mastered. The evaluation team would include 
experts from the field. Evaluation forms would also be com- 
pleted By. the students requesting them to express their 
^ belief if the program was meeting their needs, (b) the use of 
stpgent follow-up studies for students and employers of stu- 
) dents that have completed the program and the distribution of 
this information to the program staff including the teacher. 

Student and employer follow-up is a part of the 
Florida Plan fdr Vocational Instructional Program R^iew 
but the information obtained from this segment of the 
evaluation is *not always provided tft the teachers.. » 
Several of the instructors were not aware that the* student 
O follow-ups, and employer follow-ups were conducted. 
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The evaluation of the BVIPRC was administered 

during the self -evaluation portion of the field test by; the 
participants and the data were analyzed by the researcher at 
a later time and shown in Table 33. A /scale of a Yes H and "No" 
was used to indicate if the instrument' provided the informa- 
tion necessary to determine if the program (s) met^the require- 
ments as specified by the State of Florida Five Yefetr Mini 
Plan 1978-79, based on the state of'Florida Five Year Plan 

4 

for Vocational Education. A minimum of 60% of the respon- 
dents had to indicate that the instrument met each require- 
ment for it to be appropriate for the evaluation of BVPs. 

addition, the evaluation instrument provided further vali- 
\ dation of the standards and criteria, as relevant to the 

evaluation of BVPs. Table 33 shows the analyses of data 
obtained front the evaluation of the BVIPRC (CIV) , The ana- 

\ 

lyses of the evaluation instrument data showed that the respon- 
dents believed that the objectives of the program review 
specified in the State^oard of Education, Five-Year State 
Plan for Voca(ional Education for the State of Florida, 
were met by a minimum of 60\6% of the responses. . 

The respondents who believed there was a need 
for improvement or change to the BVIPRC gave the following 
suggestions as to the most effective way(s) that it could 
be determined "if the student needs were being met." The 
. respondents to the BVIPRC evaluation made the following 
suggestions: 
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" Speak to the students and check their exit 
competencies under normal conditions." 

"To obtain a better input, have students, 
present and past, evaluate the program for meeting their 
needs, interests and abilities." 

"*Jse pretest/posttest to determine the English 
competencies of the students." 

b. Determine if the program satisfies the 
requirements of the occupation or occupational field in 
which the training is given. Comments: 

"To obtain better evaluation, have program 
evaluated by people in the field of training." 

"If reviewing an IMT lab have specific questions 
on areas of instruction being conducted." 

"Need Spanish materials." 

c. Determine if the program meets the 
requirements set for it by the, State ?pard of Education 
for the operation of vocational education programs and 
their related areas* Comments: 

"On ^ teacher was unaware of any 
standards for students desiring entry into 
the, vocational programs. 19 

J. Do you have any other suggestions that 
this information? Comments: 
"Classes should use audiovisual materials." 

210 
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^ 1. Were the* directions on the Self -Evaluation 
Form clear and explicit? • Comments? 

Have one type of question throughout the 
questionnaire. Remove the sometimes, never, always. 

2. Was the information f o^completing the Self- 
Study Form clear and explicit? Comments: 

"Simplify." 

3. Were there any standards and/or criteria that 
you believe should be £gded or deleted from this instru- 
ment ? Comments : 

"Some sections could be subdivided for the 
vocational teacher and the ESL/IMT instructor." 

"Standards and/criteria are o.k., providing 
materials are available. The questions concerning 
administrative funding should be removed. 

4. Do you believe* this instrument will provide 
the following information: / * v 

a. Determine if the program meets the needs, 

interests, and abilities of the students? Comments: 

"In certain occupational areas, the success 

can be determined by the number of students who pass 

»• 

licensing or certification examinations. » 

"Students should be asked to evaluate the 
program when they have completed, and their feedback 
provided to the teache i^ " 
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"Need for new equipment . if 
"Instructors should be paia to attend. up- 
dating skill workshops." ^ \ ? 

"Provide additional/funds. " h 
"Divide the instrument so as to have, a section 
for each — the administrators/ ..teachers, support personnel 
(guidance, paraprofessionals, occupational specialist, 
etc.), and students." 

The evaluation of the BVIPRC and the comments 
of the participants suggest that there is a need for the 
inclusion of the students and support personnel in the 
evaluation of vocational programs <*ith LEP9 students 
enrolled: The ESL classes that are provided through the 
use of IMT funding may require the development of another 
instrument aimed at their objectives.* 
Or. -Site Visit Observations 

The observations of the researcher and the sug- 
gestions of the participants for the improvement of 
vocational instruction of LEP students and the evaluation 
of those programs are presented below in a summary. The 
researcher observed the vocational programs in the State 
of Florida that ranged from ESL priory to admission to 
mainly target language instruction. 

It was observed by the researcher tfhat bilingual 
vocational classes were conducted when the student 

N 
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population was. mixed, "Anglo" (English speaking only) 
and T 'EP students. This was in the event that the ' 
instructor was bilingual. Additionally, English dominant 
instructors with- LEP students were heard instructing the 
students in the target language and English. It was further 
noted that in classes with LEP students of one target 
language and instructors thal^ spoke the same language, 
mos£ of the communication was in the target language. 
An administrator in one of these schools explained 
that there had been a time when an ESL instructor had 
been hired 'and time provided, during the vocational 
class time, for students to attend. The students 
did not attend the ESL class but went directly to the 
vocational class. 

A bilingual vocational instructor stated his 
belief that the job of the vocational instructor was to 
instruct the occupational area, not English. If the- 
students wanted to learn "English" it was up to them. 
He^further stated that If the regulation were changed, 
not to permit target language instruction, he would 
instruct just in English* he was not being paid to do 
bilingual education and /or teach the students English. • 

Another instructor said that "if they 
(the students) cannot understand English, why should I • 
be bothered to teach them?" These ideas presented by 

2*9 
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members of the Various staffs were ; f ound within the* state of 
Florida, and expressed some idea of the attitudes held by , 
instructors. 
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CHAPTER V 

SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 

This study was designed to develop a process evaluation 
component for bilingual vocational programs as part of the 
Vocational Education Instructional Program Review in the State 
of Florida. The model developed includes those criteria and 
standards identified during the study as necessary for 
effective BVPs. These identified standards and criteria 
are in addition to those required for traditional vocational 
education by the Florida Department of Education. 

Summary ^ 
The data collection for this study was completed in 
three parts. The first part required *n instrument to 
be developed for the .identification of the participants' 
beliefs as to the additional staff, staff skills, materials, 
facilities, equipment, supplies, and curriculum components 
required for BVPs in addition to those required for 
traditional vocational education. The instrument also 
provided for the standards and criteria which, when met, 

t 

would provide effective BVE. 

The questions this aspect of the study were designed 

t 

. • ** « 

to answer were the following: 
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1. What were the requirements for staff in 
BVPs in addition to those required for tradi- 
tional vocational staff in the State of Florida? 

2. What were the facilities, equipment, and 
materials needed for the instruction of Limited -English- 
Proficiency (LEP) students in vocational education in 
addition to those required for English speaking students 
in the State of Florida? 

3. What curriculum components were needed for 
the instruction of LEP students in vocational education 
in addition to those required for the English speaking 
students? 

4. What, if any, additional standards and criteria 
relevant to BVE and VE have not been incorporated into 

the VEIPR? x 

The instrument ysed in this study was a question- 
naire which consisted of two sections, (a) the iden- 
tification of the additional staff, staff skills, facili- 
ties, equipment/ supplies, materials, and curriculum 
components necessary for the effective instruction of LEP 
students, and (b) the identification of the standards 
and criteria that, when met, would indicate the provision 
of effective BVE. The data collected by the use of the 
questionnaire were used in the development of the BVIPRC. 

r 
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The second part of the study, the development of the 
BVIPRC, Included review by the panel of experts and revisions 
based on thei4 recommendations. The revised BVIPRC was 
pilot tested. 

The third and final segment of the study was the revi- 
sion of the BVIPRC based on the^ analysis of data from the. 
pilot test responses and the suggestions of several of the 
staff from the Bureau of Vocational Research, Dissemination, 
and Evaluation, Evaluation Section that had reviewed the instru 
ment. The revised instrument was field tested wi^h BVE 
personnel in the State of Florida. 

The data collected in this three-part study wer^ 

analyzed in three ways. The questionnaire (QIV) responses 

were analyzed to determine the respondents' beliefs in 

reference to the additional program and staff needs, stan- 
za 

dards and criteria necessary for effective BVPs with the 
State of Florida. The additional needs were identified by 
the use of three analyses; the first was the identification 
of the respondents' beliefs as to the number of LEP 
students as compared to ES that could be effectively, served 
by instructional and support personnel in a vocational 
program. The analysis of the responses was accomplished 
by calculating an average for each schbol whose staff 
participated, and then for the total responses. 

The additional needs for facilities, equipment and 
supplies were determined by the use of the ratings given 
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by the respondents oh a scale of "less," "the same" or 
"more 11 for each area. The analysis was by the use of cumu- 
lative frequency and percentage. 

\ 

The additional staff skills/ curriculum components 

and materials for BVPs as compared with traditional vfrs 

were determined by the use of a three-point scale of 

" necessary," "undecided" and "not necessary." The analysis 

was by the use of cumulative frequency and percentage. 

The data obtained during the pilot test of the BVIPRC respon- 

t 

ses were analyzed by the use of a scale of "both," "BVE only, 
"ESL" and "not appropriate" to further determine the relevance 
of the criteria for the standards. The analyses utilized 
were cumulative frequency and percentage. 

The field test of the BVIPRC was evaluated by the 
respondents. The participants indicated their belief as to 
whether or not the information obtained by the use of the 
BVIPRC would indicate the degree to which the program was 
"meeting the state of Florida objectives for vocational 
education programs. The scale was a two-point "yes or no" 
with a request for further information for those objectives 
that were not met. The responses were analyzed by the use 
of cumulative frequency \and percentage . jj 

The analysis olt the data collected concerning 
participants* perception of the needs of LEP students 
and ES students enrolled in VPs, LEP students have numerous 
special needs. The special needs identified during this 
study were: (a) Personnel ; the vocational instructor — 
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bilingual or monolingual—can eff ectively instruct 
approximately half as many LEP students as English 
speaking (ES) students. The ESL instructor is considered 
necessary for the instruction of LEP students. The 
support personnel, paraprof essionals , guidance, and crthers 
were believed by the respondents to be able to effec- 
tively sejree fewer LEP students than ES students. The 
number of students that can be effectively served by the 
support personnel was slightly less for the LEP than 
the ES, but did not appear to require additional staff. 

(h) Facilities ; the facilities, equipment, and materials needed 
for the instruction of LEP students were perceived to 
be the same for the instruction of LEP and ES students 
enrolled in vocational classes. Some respondents 
perceived a need for additional facilities for smaller 
' group instruction. These respondents believed that the 
LEP students were more effectively instructed in smaller 
group situations than, traditionally used ^in their classes 

for ES students. 

(c) , Curriculum ; The curriculum components per- 
ceived as necessary for the instruction of LEP students, and 
not for the ES students, were language improvement (English) 
* and culture" (American) . These additional components could 
provide the students with the communication and social skills 
necessary for employment in their area of training. 
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(d) Standards and Criteria : The standards and 
criteria, which, when met, would 4 provide effective VE for 
the LEP students enrolled were identified by the procedures 
employed in this study. The initially identified standards 
and criteria were reviewed by a panel of experts and re- 
vised as needed. The participants ' in the study then expres 
sed thai- beliefs as to the validity of these standards and 

criteria to VE programs with LEP, students enrolled. 

i 

The initially validated standards and criteria 
were utilized in the development of the BVIPRC to the 
VEIPR for" the State of Florida. The component was then 
pilot tested and*\hanges made 4 as needed. In addition, the 
pilot test participants revalidated the standards and 
criteria for VE programs with LEP students enrolled. The 
validation was conducted by means of a one-to-one inter- 
view between the researcher and the respondent. 

(e) Validation of Standards and Criteria : The 
revised BVIPRC was then field tested and evaluated by per- 
sonnel who had not previously participated in the study. 
The analysis of data from the evaluation provided further 
validation of the standards and criteria for vocational 
programs with LEP students. 
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Conclusions 

The purpose of this study was to develop the process 

evaluation component for the State of Florida Education 

• • * * 

Instructional Program Review (VEIPR) that was 
applicable for vocational programs with Limited English 
Proficiency CLEP) students enrolled.* The foregoing material 
in this*, study provides fulfillment of the initial task with 
the development %f the Bilingual Vocational Instructional 
Program Review Component CBVIPRC} . In addition, there 
were experiences and findings and these enable the researcher 
to .make further conclusions, as follows. 

The BRIPRC provides the educational consultant an operational 
evaluation instrupjut wirn tne information necessary to determine the 
type of instruction being employed for meeting the needs of 
the LEP students/ The procedures employed in the development 
of the BVIPRC included the identification of standards and 
criteria which, when met, would indicate that effective 
Bilingual Vocational Education (BVE) was being provided. 
The' standards and criteria Were identified. as valid when a 
minimum of 60% of the respondents indicated that they were. 
The 60% minimum response provided for a working majority m 
with a 10% error factor. 

The standards and criteria were shown to be valid 
in content and reliability of interpret^jpfcm by analyses of 
the data obtained from the respondents who participated in 
this three part study, which were: " (a) the completion of a 
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questionnaire to identify initially the standards and 
criterra-r^Cb! pilot testing, and CO field te- cing cf the 
components, fhe component also included c--' 1 - -ia found to 
be invalid, but these were included for tne purpose of 
allowing school personn 1 to check off the procedures that 
wese employed to meet the needs of LEP students. 4 

The accuracy of interpretation of the standards and 
their criteria was determined by the responses of the parti- 
cipants during the one-to-one interview conducted during 
each: of the three parts of the slju&y. The standards and 
criteria found valid during this study are cortsisterfo with 

4 

the existing objective* of BVE as specified in the literature 
These facts suggest that the BVIPRC provides the information 
necessary to indicate the type q£ program being v 

« 

employed and to determine if the program is meeting the 
standards and criteria identified as necessary for Effective 
BVE. The information obtained from, the component provides 
data that can be used by the- state department personnel for 
decision making in reference to the programs -addressing 
the needs of the LEP students enrolled-. This information may 
also be used to indicate the areas where improvement and/or 
change is needed in order to provide more effective education 

"of the LEP students. 

' Recommendations 

The findings, of this study' indicate that a majority 
of the participants believe that product and context 
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' evaluation should be added to the process evaluation of 
vocational programs with LEP students. The addition of 
product evaluation would provide further indication of the 
effectiveness t>£ vocational instruction of the LEP students. 
The areas to be included in the product evali^tion section 
of the program review are: student skill evaluation, and 
student input in the area of program effectiveness. The . 
skills necessary for the instructors of LEP students woul-i 
be included' in the context evaluation. The majority cf 
the participants believed that the evaluaior or evaluation 
team member (js) should be knowledgeable in the occupational 
area being evaluated: for example, the review of a shorthand 
class should be by a stenographic supervisor. 

The product evaluation segment of the program review 
should include the evaluation of the students to determine 
if their occupational skills are adequate for their level 'pf 
attainment as recorded in their progress files. The students 
who are evaluated should be randomly selected by the consul- 
tant from the total students enrolled in the program. The 
students should also be requested to express their beliefs 
as to whether or not the program meets their needs for voca- 
tional instruction. 

^The context evaluation segment of the BVIPR should 
include the evaluation of the instructors to determine 
whether or not they are skilled in the* additional areas 
identified as necessary for the instruction of LEP students, 

r 
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i.e. language target and culture target. The information 
obtained should be used for the identification of the areas 
in which staff improvement opportunities could be offered. 

It is recommended that the Florida State Legislature 
apDro^SrJate funds that would provide for the additional 
instructors', identified during this study as necessary for 
effective BVE. This would provide for the reduced .teacher 
student ratio that was believed to be approp.-iate by the 
respondents for effective BVE. 

The findings of this st also showed that LEP 
• students require additional education components in cultural 
skills (Awrican mainstream) and language (English) . These catponents 
are not consistently includad in the EVPs and among those 
that do include them no consistent levels were identified. 
Criteria shou 1 ^ be developed and included in the process 
model, thus providing a standardized level for minimum 
requirements for these components. Thi.s information 
would further indicate the effectiveness of the BVE being 
provided.^ 

0 

Recommendations for Further Research . 
Based on the findings of this study, the following 
are recommended for further research: „ t 

1. A study 3hould be .undertaken to identify specific 
methods of product evaluation to determine the 
ability of the students (ES and LES) to perforr. 
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the competencies required for entry into the 

occupational area. This would indicate additional 

instructional needs within the program, and 

identify those procedures that are being employed 

in the instruction of the LEP students. 

« 

An input evaluation model should be developed and 
implemented to identify effective procedures for the 
instruction of LEP students. The need for effec- 
tive procedures was shown by the repeated requests 

by instructors for materials developed for the LEP 

* 

students. The information from the input evalua* 

tion would assist those instructors not familiar^ 

with the methods necessary for the instruction of 

LEP students and would eliminate the need 

to develop materials that have previously been 

produced. 

A follow-up system for program ? leavers " and 
"completers 11 that provides the instructors with 
follow-up data within a reasonable time should 
be developed. The information from the recent 
follow-up reports could then be used by the in- 
structors when they are evaluating and revising 
their programs. The researcher found that few 
instructors received follow-up data, and of those 
who had received the information, it was several ♦ 
years old. 
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4. The process evaluation model should be expanded 

j to include criteria that when met would indicate 

the degree $.0 which the special needs of the LEPs 
are provided. The special needs identified 
curing this study included English language 
comprehension and American cultural understanding 
The information obtained from the evaluation 
should be used to identify instructors with 
exemplary skill and employ them to assist othets 
in obtaining and utilizing these skills. 

5. A meta evaluation of the BVIPRC should be deve- 
loped and implemented. The 4 meta evaluation 
would: Cal provide the information as to the 
validity of t!he standards - and criteria for pro- 
ducing students with the skills necessary for 

^employment, and lb) determine if there is 

a correlation between process evaluation and pro- 
duct* out borne. 
The procedures employed in this study were those * 
required to develop a process model for the evaluation of 
BVPs. The process model determines the quality of the 
programs being provided. The respondents additionally 
suggestod the inclusion of product evaluation, to determine 
the effectiveness of the program* and context evaluation, to 
identify the needts) for change in a program and identify new 
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curriculum sources. These respondents also suggested an in- 
put; 'evaluation, for the identification ancj assessment of the 
system's capabilities and strategies for overcoming dif- 

ficulti.es in meeting project objectives (Apramson, 1979, 
c 

p. 141), The information context, input, proces.s, and pro- 
duct evaluation would provide a system for program 
improvement an/ determination of program effectiveness. 
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Appendix A 

Telephone Survey 
Population Identification 



Population Identified 181 
oy Location by Seed 

fffcr BVPs * 



Region 



Papulation 



Need for BLVEPs 



Columbia 
Bradford 
Suwanee 



Flagler . 

St. Johns 

Levy 

Putnam 

Duval 

11 
Alachua 



Okaloosa 



Santa Rosa 
Washington 

Bay * 

Wakulla 
Jefferson 

Marion 

Orange 
Cscecla 



** 



Indo Chinese 
•Migrants 
Mew Ohandan, 
Indian 
Korean 
Latin 
♦Migrants 



Utin 
Vietnamese 
•Migrants 

Vietnamese 



if** 



Portug 
Carman 
Vietnamese 
Chinese > 
Latin 
Vietnamese 
Garman 
Portugese 
French 
_ Filipino 
Utin 

Vietnamese 

Pakistan 

Vietnamese 



Latin 
Italian 
Utin 
Swedish 
German 
"Utin 
French 
Vietnamese 



Mo 
No 

Adults , especially 
Koreans , k Spanish 
speaking peoples 

Dependent on Cuban 
influx 

No - 
No 

Dependent on Cuban 
influx 
No 



No 



Dependent on Cuban 
influx 



No 

NO 

Dependent on Indus- 
trial growth 



Dependent on Cuban 
influx 
Yes 

No. 
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Population Identified 
by Location? by Heed 
for BV?s 



In** 



Region 



Population 



Need for BLVZPs 



Hi 

Suater 
Lake 

IV 

DeflOtO*— 

Hardee 

Hillsborough 

LH 

Manatee 
Sarasota 



♦Migrants 
Vietnamese 



Latin 



* Latin 
**Latin 
Indo Chinas* 
'Latin 
Indo Chinas* 
***Mixed 



NO 

On Adult Level 



No 
Yes 

NO 
Yes 
Yes 

NO 



St Lucy 

?al« Beach 
Okeechobee 

Martin 
Sr award 
Dade 



** 



## 



**. 



Latin 
Latin 

Nicaraguan 
Latin 



t Latin 
Mixed 
"'Mixed / 



Dependent on Cuban 
influx 
No 

"Strong Need 

Yea 
Yea 
Yea 



* Migrants • 
** Latin • 
>** Mixed • 



aoatly Spaniah speaking peoples and blacks 

mostly Spaniah speaking peoples 

represent at least 42 different nationalities 
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Appendix B 
BvPs in the state of Florida (1381) 
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. iUtl Ot fU>€ Ida ' 

al lingual Vocational Education Progrooa 
IdantUlad oy Tulapfccao iurvay Conduct ad 
May It - Juno i v iiitf 



Location 



Cent Act 

NCMQ 



Talapnona 



Program 
.Statu* 



vocation*: 
Prograo 



Population 
Sarvad 



Myrtle Grova Ana** 
for oacastlonai atwOanta 

Golf 

Soil Coast Coo. Col. 



IV Pasco 

Paaco Cooproaono Ua II 19a 

fiMlUa 

Manatao 
Axaa 7oc- Tocn Candor 
at 

V Collier 

Voc-Tecfcnlcal canter 

r 

Dade 

Hieei Saaior Molt Ctr. 



f,i«daey Hop* inn Vo :tr . 

!»ow '4or:c Cu, Coo. Col. 
M'Jlt Cd. tngllaa Cu. 



> Nandry 
laiiella High School 
Cleuiaton Miga School 



•ustin 
ladlentoun Mult Cu . 



Jaooa Jordan ,944*430-4 *U 

ortowle leoer »Q4*7et-l3Sl 



Janet ftellly 

Mre. M. Hunt, OH. 

Donald Met* led 

Or. K. Parry 

Dr. Keff lennatt 

2r. ?ca Csarsay 

Nancy aoea 
Den Willie** 

Mr. Ooolay 
Mr. Garcia 



S04-M7-474? 
•1J-5J1-JW1 

♦13-753-2*41 

•U-774-a.jS 

103-443-0414 

1 

303 3JC 2224 

J0S-S43-SS03 
JC5-MJ-SS20 

•1J-47S-044S 

ios-s*'-a«4« 



Continuing 
Continuing 

Tosoinataa i/iO 
'ending (fundi) 

Continuing 

Continuing 

Continuing 

Cwlltllltllliy 

Tarolnaraa 7/tO 
Continuing 

Continuing 
Continuing 



ML* 
Cenarel 

tSL 

Sectral 
Career Ed 



Agrl« Id 
Coanotology 



(ftUI) in ind. Area, 
lua. Cd., 
Oistrio. Ed. 

tBLwCj Motel angot. 



( tL'/E) tua. Id. 

tOnoff icial) 



Agci. ed. 



On Need 



•Mt • tngllao aa aacond language 

••UL • cngl&ao'aa aacond language (funded by Vocational Education) 



viaananeae 

All L2SA roc. 

Spanian 
viatnaoaao 

tndo Cninoae 

Spanian 



Span i ah 
Haitian 



Spanian 
Haitian 

Spanian 

Spanian 
Haitian 



Haitian 
Spam ah 
Hicccau4aa 



Spanian 

Careen 

Vi«iraoaaa 



erJc 
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Schools Used in Study 



Collier County Vocational-Technical Center 
3702 Estey Ave. 
Naples, Florida 33942 

English Center 
3501 S. W. 28 St. 
Miami, Florida 33135 



Program: ESL 



Program: BVE 

ESL 



George Stone Area Vocational Center 
Route 10, Box 530 
Pensacola, Florida 32506 

Gulf Coast Community College 

5230 West H'Way 98 

Panama City, Florida 32401 

Indiantown Adult EduuffliBii Center 
P. O. Box 336 
Indiantown, Florida 33456 

1 

LaBelle Middle School 

Ft. Thompson Ave. 

La Belle, Florida 33935 

Lee County Area Vocational-Technical 

Center 
3800 Michigan Ave. 
Ft. Myers, Florida 33901 

Lindsey Hopkins Educational Center 
1410 E. Second Ave. 
Miami, Florida 33132 

» 

Miami Lakes Technical-Educational 

Center 
5780 N. W. 158 St. 
Miami Lakes, Florida 33014 

Miami Senior Adult Center 
2450 S. W. First St. 
Miami, Florida 33132 
\ 

Miami Skill Center 
50 N. W. 14 St. 
Miami, Florida 33136 



Program: ESL 
VE 



Program": ESL 



Program: BVE 



Program: ESL 



Program: ESL 



Program: BVE 

ESL 
VE 

Program: ESL 



Program: BVE 



Program: ESL 
BVE 
VE 
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Schools Used in Study (continued) 



South Dade Adult Education Center Program: ESL 

26401 S. W. 167 Ave. 
Miami, Florida 33030 

South Dade Skill Center Program: ESL 

28300 S. H. 152 Ave. 
Leisure City, Plorida 33033 



i 



240 



X 



J 



1S7 



Appendix C 
Interviews 
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Interviews 

Aaams, Susan 3., Project Director, Bilingual Vocational 
Education , Western Kentucky University, Departme 
q£ Career and Vocational Teacher Education, 4 August 
1980. ' ' 

Babcocic, Marylin,' Director, Disseminaiton and Evaluation of 
• Bilingual Education, 6 June 1980. 

Blumbeld, Lloyd, Director, Department of Adult Education, 

Dade County, .Florida 8 July 1980. 

Roy, (Ph.D) = 4 - 

Giehls, Program Director, Evaluation Section, Division of 

Vocational Educaiton, state of Florida, May 1981. 

Gunderson, Director of Bilingual Vocational Education, 

Department of Health Education and Welfare, Washington 
D.C. 12 August 1980. 

Hannenburg, Vera, Director, Department of Grants and Evaluaitcn, 
Board of Education, City of^ New York, 3 September 1980. 

Harrell,, L. W. , Section Director, Program Implementation Sec- 
tion-^Regional Offices, state of Florida, April 1981. 

Kanaarakis, John C. (Ph.D) Bilingual Education Specialist, 

Department of Education, state of Florida, April 1981. 

Labato, Norma, Bilingual Coordinator, Hillsborough County, 

Department of Education, state of Florida, 9 April 1980. 

''Lawrence, John E. Director, Division of Public \schools, 

Adult and Community Education Section, Department of 
Education, Tallahassee, Florida, 10 April 1980. 

Maes, Daniel, Department of Migrant Education, Tallahasse 
Florida, 9 April 1980. * 

Rezabek, "Dale, California Advisory Council on Vocational 
Education, Sacramento, California, 8 July 1980. 

Sanchez, Frank, Office of the Lt. Go^/emor, Tallahasse 
, Florida, 9 April J.9 80.' / 

Troike, Rudolph, Director, Federal-Evaluation Project for 
Bilingual Vocational Education, Arlington, Verginia 
„ l£,June 1980. « 

Others 
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Appendix D 
Questionnaire Materials 
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ColU^e ox Education 
par; rr.cn: of Education*! 
Leadership 

Vdca:;onal Education 

206 Sou:h Woodward 

>G4, 644-6298 



The Florida State University 
Tallahassee, Florida 32306 - 
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Occober 30, 1980 



Mr. Garcia 

Indiancown Adult k 

Education Center 
P. 0. Box 33 6 
Indiantovn, Florida 33456 

Dear Mr. Garcia: 

Thank you for agreeing to participate in the study tc • 
identify the special -needs # standards and crieeria necessary 
for effective Bilingual Vocational Education Programs in the 
state of Florida. The information provided by this study 
will be used in the development of the Bilingual Vocational 
Education component to the Vocational Education Program Review 
* „ for Floridiu 

I am looking forward to meeting with you on Novemeber 5, 
1980 at 1 p.,nw. Again, thank you for ybur participation. 

Sincerely, 



Mary A. MarangoQ 
Research Assistant 



v ♦ 
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Questionnaire Narrative 

c 

My name is Mary Anna Marangos, representing Florida , State Uni- 
versity. I am working on a project to identify tho standards and 
criteria, which when met, would provide effective Bilingual Vo£ational 
Education Programs. 

I am asking for your help in the development of *the questionnaire 
that will be used to identify those standards and criteria. With the 
input of Bilingual Vocational Educators we can develop a useful instru* 
merit - 

I have provided you with the complete questionnaire packet and a 
suggested critique outlinfe,' however, please feel free to make any 
comments directly on the directions, quesionnaire, or critique form. 

/ 
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Pilot Test Data (Questionnaire) 
Name of School , 



Address Telephone 



Date Time In Time Out 

Number of Participants 

Number that were Teachers A dministrators 1 

^rasj Others (specify)- 

Time needed for oral directions: 

reading directions: 

review with example : 

Time needed for completion of test: 

Total time: 



Other comments: 



9 
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f 

Critique Suggestions 



Please feel free to write on any pare of this questionnaire 
packet. 

I. Cover Sheet 

^ 1« The cover sheet is appropriate* Yes No 

• 2.. Parts of the cover sheet should be: 

Added to (specify) : 



Deleted (specify) 



Modified (specify) 



II* Oral Directions 

1* The oral directions are appropriate* Yes No 

2* Parts of the oral directions should be: 

Added to (specify) 



Deleted (specify). 



Modified {specify). 



III. Written Directions 

1. The written directions ere appropriate* Yes No 

« 

2. Parts of the written directions should be: 
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Added to (specify) 



Deleted (specify) 



Modified (specify). 



IV. Questionnaire 

Purpose: To identify those standards and criteria .which when met, 
would provide effective Bilingual vocational Education 

Standards 

1. The standards are appropriate for effective Bilingual 



Vocational Education. Yes No 

2. Some standards or segments should be: 
Added (specify) 



Deleted ( specif y)^ 



Modified (specify). 



Criteria 

1. The criteria are appropriate for the standard. Yes 

No 

2. Some criteria or segments should be: 

\ 

Added (specify) , 
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Criteria (cont'd) / 
Deleted (specify) 



Modified (specify) m 



Additional Comments: 



\ 



Thank you for your cooperation. 



College of Education 



Department of Educational 



The Florida State University 
Tallahasfte, Florid 32306 
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Vocational Education 
206 South Woodward 
(904; 644-6298 * 




October 20, 1980 



Mr. Antonio Nicolau 
Solidaridad Humana 
107 Suffo < Street 
New York, New York 10002 

Dear Mr* Nicolau: 

Thank you for participating in the development of in 
instrument to identify those standards and criteria, which 
when met, would proved effective Bilingual Vocational ^ 
Education programs in the state of Florida. With the t 
participation, of knowledgeable personnel we will be able 
to develop an effective instrument. 



Sincerely ^ 




Mary A « Marangos 
Research Assistant 



/jks 
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General Directions for Administering 



The questionnaire can be administered to an individual or to a 
group. Its purpose is to identify the standards and criteria necessary 
for effective Bilingual Vocational Education (BVE) * 

Materials Needed * 

The materials needed to administer the questionnaire are: 

1. This set of examiner's directions 

2. Qjjestionnaire 

3. Pencils 

Purpose of the Standards and Criteria Questionnaire 

The purpose of the questionnaire is to identify the standards and 
criteria necessary for effective BVE programs in the state ^pf Florida. 
The questionnaire is "designed to focus on the areas of primary, interest 
to the stater staff, curriculum, material, equipment, and supplies. 

Directions Questionnaire Administration * 

Read to Participants 

Thank you for agreeing to participate in this study to identify 
the standards and criteria necessary for effective BVE programs in the 
state of Florida. The results of this questionnaire will be used in 
the development of^ the gvg component of the- Vocational Educa t ion Program 
Review for Florida. Following the development of the component, it may 
s be necessary for us to request your further cooperation. 

The following pages contain a series of standards and criteria for 
BVE. You are asked to decide whether each standard and criterion is 
necessary for effective BVE program? Any feedback on items that you 
feel should be, deleted, modified or added is welcome. 

Please write any comments or additional items on ,the back of the 
pages and do not forget to write the number or letter of the standard 
or criterion next to your" comments or items. 

You will notice that your name is requested. This is done only 
in case there is difficulty in interpreting any comments and we need 
to ask you for additional Information. You need not give your name or 
background information if you do not wish. Your response, along with . 
those of others who respond will be Summarized, thus, your response „ ' 
will remain anonymous. 
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General Directions 
Page -2- 

Please turn to Page One of the Questionnaire as I read the 
directions. 

Task I. 

a. Read each of the standards on the questionnaire. 

b. ' Circle the program for which each standard ie the most 

appropriate as follows: ^ 

1) Bilingual Vocational Education (BVE ). BVE programs are 
designed to provide students with vocational skills and 
knowledge of vocational English necessary for entry level 
employment in the occupational area of instruction. , The 
languages of -communication in the BVE program are English 
and the dominate language of students in attendance. 

2) Vocational Education (VE). VE programs are designed to 
provide students with vocational skills necessary for 
entry level employment in the occupational area of 
instruction. The language of communication in the VE 
program is ENGLISH . ONLY * 

3) Both (BVE 6 VE).. The identified standard is equally rele- 
vant to BVE artti VE programs. 

• * • 

4) None. The standard is not necessary for effective BVE 
and/or VE programs. 

c. If a standard identified as appropriate for VE only. (2) or 
# not appropriate None (4) j DO NOT RATE THE CRITERIA , go to 

the next standard. 

Task II. 

a. Read each criterion for those standards appropriate for BVE 
or Both. 

b. Circle the response that most nearly represents your feeling 
as to the degree you agtee with the appropriateness of the 
criterion for the standard in effective BVE programs. 

c. In making your response, circle 1# 2, 3, 4, or 5* as follows: 



1. Strongly Agree (SA) 



2. Agree (A) 



3* Undecided (U) 



4. Disagree (D) 
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if the criterion described would have • 
considerable impact in meeting the 
standard in effective BVE programs. 

if the criterion described would have 
a moderate impact in meeting the stan- 
dard in effective BVE programs. 

if you arp not certain whether or not 
the criterion would have any impact 
in meeting, the standard in effective 
BVE programs. 

if the criterion described is not 
necessary in meeting the standards 
in effective BVE programs. . 



5. Strongly Disagree (SD) if the criteripn described would 

have negative or no impact in meeting 
the standard in effective BVE programs. 

> d. If a criterion is identifed as Disagree (4) or Strongly Disagree (5) 
* go to the next criterion, DO NOT DO TASK III . 

Task III. 

a. For each criterion determine if i£ is appropriate for BVE or BOTH. 

b. In making you response circle 0 or 1 as follows: 
0. Both 



1. BVE ONLY 



the criterion is appropriate for BVE 
and VE programs. 

the criterion is appropriate for BVE 
only. 



Before returning the forms* please be certain that you have responded 
to all items. Are there any questions? 

Thank you for your cooperation, 



} 
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( C partment of Educational 
Leadership 
Vocational Education 
206 South Woodward 
(9C4) 644-6298 



The Florida St*te University 
Tallahassee, Florida 3T 06 
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Thank you for supporting the, study to identify those 
criteria and standards' for vocational education programs for 
the Limited-English-Speaking (LES) students in the state of 
Florida. The analysis of the data from this study will be 
used in the development of a component for the Vocational 
Sducation Program Review in Florida which may be used for an 
equitable review qf Bilingual Vocational Education and 
Vocational Education programs that have a substantial number 
of LES students. 

We are locking forward to your further support of 
this study. Only with the cooperation of personnel who are 
knowledgeable in the area will we be able to develop an 
effective instrument. 

Thank you agairi for supporting the study. 

Sincerely/ 



Mary A. Marangos 
Research Assistant 



Hollie B. Thomas 
Project Director 
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Appendix E 
BVIPRC Pilot Test Materials 



College of Education 
•Department of Educational 

Leadership 
Vocational Education 
2C6 South Woodward 
l904) 644-6298 



The Florida State University 
TalUlussee, Florida 32306 
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As per our conversation on, January , 1981, . I am enclosing a copy 
of the pilot test for the Self-Study Program Review form for programs 
with Limited English Speaking (EES)' students. These are programs iden- 
tified as Bilingual Vocational (BV) , Vocational English as a Second 
Language (VESL) with traditional Vocational Education (VE) and traditional 
Vocational Education without a VESL component. 

In order to pfoduce a useful Program Review Component to the 
Vocational Education Instructional Program Review for the state of Flor- 
ida, it is important- to have your cooperation and input. Please complete 
the enclosed program review form for your program, and return it to 
me on February , 1981, when I will be in your school .to conduct the 
On-Site segment of this study. If you have any additions, deletions, 
modifications please write them on the form. I would appreciate the 
opportunity to discuss your recommendations and/or suggestions for 
the^ development of an 'efficient Vocational Education Program Review 
instrument for programs with LES students during the On-Site visit. 

I look forward to meeting with ybU in the near future and appre- 
ciate your willingness to cooperates 

Sincerely, 



or 



Mary Anna Marangos 
Research Assistant 



/jks 
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Your program has been selected and permission obtained from your 
supervisor/administrator to be a site for 

a field t«st for the development of the Bilingual Vocational Educa- 
tion component of the Vocational Education Program Review for the 
state of Flbrida. For the success o£ this project your cooperation 
is most important. Enclosed is a copy of £he Self-Evaluation form 
that is intended for the instructors/administrators of Bilingual 
Vocational Education programs in the state of Florida. 



/ 



Please complete the enclosed form, for your program, and return 
it to me by * when I will be conducting an on-site 

program review. If you have any additions* deletions, or suggestion % 
please write them on the form. When we meet, at the post review con- 
ference on I would like to discuss your recommendations 
and/or suggestions with you. 



Thank you for your cooperation. 



Sincerely, 



Mary A. Marangos 
Research Assistant 



/jks 
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* PILOT TEST 

THE VOCATIONAL EDUCATION INSTRUCTIONAL PROGRAM REVIEW 
IN THE COMMUNITY COLLEGE AND ADULT EDUCATION CENTERS 
IN FLORIDA FOR BILINGUAL VOCATIONAL AND 
1 VOCATIONAL ENGLISH AS A SECOND LANGUAGE PROGRAMS 



Directions for Complet ing Self-Study Form 
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WHAT IS THE VOCATIONAL EDUCATION INSTRUCTIONAL PROGRAM REVIEW? 

In v.? present case, the researcher is attempting to adapt the pro- 
gram review procedures to BVE and LES programs. Thus, no state 
staff will be involved in this review. The influx of Limited English 
Speaking (LES) students into the educational system of Florida has 
presented a new demension to vocational education. The needs of the 
LES students are in certain aspect^ greater than those of the English 
speaking student. The state of Florida in order to meet the needs of 
all its students has authorized the reexamination of the vocational 
program review instrument. 

The following pages contain a program review instrument designed to 
determine whether or not the needs of the LES students are being met 
in vocational programs that they are enrolled in. The researcher 
is requesting that you, as an instructor of LES students, complete 
the instrument for your program. In addition, would you make any 
additions, deletions, or modifications that you feel are necessary. 

In its usual form program review is a joint evaluation of individual 
vocational education programs by instructors, school administrators, 
and regional program consultants. The purposes of such a review are 
directed towad insuring that vocational instruction: (1) meets the 
needs, interests, and abilities of students; (2) satisfies the require- 
ments of the occupation or occupational field in which the training 
is given; (3) meets the requirements set for it by the State Board 
of Education for the operation of vocational education programs. 

WHY ARE THE REVIEWS OF VOCATIONAL PROGRAMS CONDUCTED? 

The primary purpose of program review is program improvement. Per- 
iodic evaluation is an excellent means of assuring that corrective 
action is taken as problems arise. In addition, there is the contin- 
ued emphasis throughout the educational community on accountability. 
The Florida State Plan for the Administration of Vocational Education 
under the Vocational Amendments of 1976 contains provisions for pro- 
gram evaluation. The program review process is a standardized procedure 
designed to meet th<* need* and requirements of local, state, and 
federal agencies. 

HOW WILL THE PROGRAM REVIEW PILOT TEST WORK? 

The researcher will provide the local Bilingual Vocational Education 
(BVE) /Vocational English as a Second Language (VESL)/ Vocational 
Education (VE) educational agency with program self-study forms. 
These forms list the standards which will be verified by the researcher 
during a later on-site visit. A review form will be completed by 
the researcher and correspond to the self-study forms filled out by 
the-"*TC/VESL/i r, i; staff. The pilot program self-study form is designed 
to assist the researcher in developing the final version of the BVE/ 
VESL/VE Program Review Component for programs with LED students in 
the state of Florida Vocational Education Program Review. 

259 
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HOW WILL THE PROGRAM REVIEW PILOT TEST BE EVALUATED? 

The 3VE/VESL/VE staff who respond to the program self-evaluation will 
also review the contents of the instrument for its validity in eval- 
uating BVE/VESL/VE programs with LES students irf the state of Florida. 
That portion of the study will provide the participants with the oppor- 
to make additions, deletions, and modifications to the standards 
and criteria previously identified. 

ON-SITE VISIT 

After the self-study forms are completed the researcher will make a 
scheduled visit to the educational agency to conduct a verification 
of the self -study review with teaefc^rs involved in the particular 
programs. 

The major aims of the on-site visit are to determine the fextent to 
which thr report reflects actual conditions in the institution, and 
to supplement the self-study report with additional data and 
documentation* 

Points covered by consultants include: 

x 

1. Obtain rationale for recorded answers 
2. , Review evidences 

3. Allow opportunities for additions and/or revisions 

4. Assess quality above and beyond what is recorded on the 
self-study form 

5. Relate findings to teachers in a developmental and 
♦conccructive way • ' " * 

Working from self-study forms and in uirect consultation with the 
teacher (s) involved, the researcher will complete the working copy 
of th£ BVE/VSEL/VE program. 

After completion of the on-site visit, and exit conference will be 
conducted with the agency head and participating staff to discuss 
the results of the review. 

The major aims of the exit conference are to: 

1. Determine the validity of the identified standards and cri- 
teria for BVE and/or VESL/VE programs with LES students in 
the state of Florida. 

2. Determine discrepancies in the interpretation of the standards 
and criteria by the instructors and/or researcher. 

3. Determine if the program review instrument and data reviewed 
provide some assurance that the program is or is not effective. 

4. Review suggested modifications, additions, and deletions with 
staff. All responses, including suggested changes, will have 
been summarized with those of others who responded. Thus, tn* 
individual respondents will remain anonymous. 

260 
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POST-VISIT AaiVlTIES 

An oral report of the program review findings may be made to the 
educational agency if such a repot t is requested by the pre-revxew 
negotiations. 

WHO IS RESPONSIBLE FOR THE VARIOUS PHASES OF THE PROGRAM REVIEW PROCESS? 
Phase I - Program Self-Study ' 

Researcher 9 o Identify institutions and programs to be reviewed 

o Submit plan ai>d timeline for accomplishing goals 

o Arrange and conduct a planning conference with edu- 
cational agency administration to determine the 
schedule for on-site visits and the establishment of 
reporting procedures 

o Conduct orientation for educational agency staff and 
provide in-service training on the use of instruments 
if requested by the head of the agency 

Local Educational o Plan and conduct self-study program review and return 
Agency completed self-study forms to researcher 

Researcher o Review the completed self-study forms and other data 

relating to the program following on-site visits 

Phase II -On site Visit 

Local Agency o Make ^11 necessary local arrangements for on-site visits 

Researcher o Conduct an effective on-site verification of the 

self-study review 

BOUSED 1 ? ^ PIL ° T TEST * ^ BVE/VESL/VE REVIEW INFORMATION 

i 

o The data will be analyzed to determine the validity of the 
standards and criteria for reviewing the effectiveness of 
these programs in Florida 

o The data will be reviewed to determine the reliability of 

the interpretation of the standards and criteria by participants 

o The data will provide the information necessary for 'developing • 
the .inal version of the BVE/VESL/VE Program Review Component 
.or programs with LES students for the Vocational Education 
Program Review for the state of Florida 
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SUGGESTED EVIDENCES FOR STANDARDS - REFER TO NUMBERED TIMES IN SELF- 
STUDY INSTRUMENT FOR XCUPATIONAL AND COtHJNITY COLLEGE PROFICIENCY 
PROGRAMS 



Standard 1 



Standard 2 



Standard 3 



Standard 4 



Standard 5 



Standard 6 



o 
o 
o 
o 



o 
o 
o 
o 



o 
o 

o 
o 



o 
o 

o 
o 



o 
o 
o 
o 

o 
o 

o 
o 



Written program objectives 
DOE Program description 
Course description 

Written course description that is provided to 
students and parents 

Written program objectives 

Copy of funding source standard specifications 
Course description 

Written course description that is provided to 
students and parents 

(a) EhgAish 

(b) Target language (s) 

Course outline for syllabi 
Defined performance outcomes 

School procedure for modification of performance outcomes 
Criterion-referenced measures for each defined performance 
outcome 

Taa| analysis (es) of occupation (s) for which the program 
is designed 
Curriculum guides 

Textbooks and other resource materials (English and/or 
Target Language (s) 
Manpower studies 

Dictionary of Occupational Titles 

List of advisory committee memers (by occupational 
position, by race, by nationality, by language groups) 
Schedule of advisory committee meetings 
Minutes of advisory committee meetings 

Teacher's Certificate 
Special permit 

Copy of letter specifying approval of school board 
Direct observation in classroom 

On-site observation 

DOE Design Criteria for New Facilities (State Board of 
Education Administrative Rules) 
Electrical outlets 
Plumbing services 
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o On-site observation 
o Plan for equipment replacement 
o Tools and equipment inventory 
o Department budget 

o On-site observation of available materials and consum- 
able supplies 

o Brochures (if available) (English, Target language (s) 
o Program handbook (English, Target language 
o Employment information related to business and 
industry 

o Interest batteries (english, Target language) 
o Aptitude tests (English, Target language) 
o Achievement tests (English language) 
o Interview with student service personnel 
o Interview with selected students (LES) 
o written justification tot chose students not at 
appropriate grade level , 
o Written criteria for admission into class (if apy exists) 

Standard 9 o Written criteria for admission into program/course 

o Brochure (if available) (English, Target language(s)) 

o Program handbook (English, Target language (s)) 

o Interview with student services personnel 

o Number and percentage of male and female students 

o Number and percentage of students enrolled, by race, 

by nationality, and language group 

o Student goals and surveys 

o College catalog 

o Numb.-r and percentage of persons in non-traditional 
fields 

o Career resource center 

o Career education program and material 

Standard 10 o Class enrollments 

o Laboratory size and equipment* (on-site observation) 

o Class schedule 

o Instructor schedule 

Standard 11 o Defined performance outcomes for each program or course 
o Criterion-referenced measures for each Refined perfor- 
mance outcome 
o Topical outlines 

o Skill charts (English, Target language) 
o Student* profiles 
o Evaluation reports 

o Vocational student organization membership roster and 

program of activities 
o Cooperative or on-the-job placement records 



Standard 7 



Standard 8 
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Standard 12 o School policies and procedures for placement 
o Placement records 
o Interviews with placement personnel 



Standard 13 o Copies bf follow-up studies or placement records 
o Written recommendations for curricular or program 

change based on analysis student follow-up data 
o Reports submitted to Board of Trustees 
o Examples of revised course outlines 
o Minutes of curriculum committee 




Standard 14 o Interview* with instructors 

o Interviews with administrative and supervisory personnel 

Standard 15 o Staff development surveys (with special needs component 
for LBS teachers, cultural, languages, etc.) 
o Instructor's individual plan for staff development 
o In-service components 

o College staff and program development p^an and report 
GLOSSARY OF TERMS* 

Advanced Placement - Acceptance of a student in a program at a higher 
level than usually assumed by entering students 

Articulation - The relationship of an instructional program at one 
level to similar or related programs at another level 

t 

Bilingual Vocational Education (BVE) - BYE programs are designed to 

provide students with skills and knowledge of English necessary for 
entry level employment in the occupational area gf instruction. 
The languages of communication in the BVE program are ENGLISH and 
the DOMINANT LANGUAGE of the students in attendance. 

CCD (Course Code Directory) Code - The number code corresponding to 
programs and/or cQurse offered in specific area or fields as 
outlined in the 1980-81 Course Code Directory 

Competency - The abilitb (including knowledge, skills, and/or attitudes) 
to perform a specftLc task or duty successfully 

Coordinating Council - A group organised to review total vocational 
education, adult general education, and community instructional 
services programs within the vocational planning district (region) 
to make needed offerings and prevention of unwarranted duplication 

Criteria - Standards by which decisions can be made 

» 

Criterion- Referenced Measure"- A measurement device based on performance 
objectives which evaluates learners on the basis of ability to 
complete a task in a given situation according to a pre-set standard. 
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Dissemination - The production, delivery, and distribution of products 
to identified target groups 

Emplbyability Skills - Human relation skills required to obtain and 
keep a job 

Entry Level Knowledge - The minimum knowledge* required to function 
effectively in initial employment 

Evidences - A basis for supporting or proving response 

Fundamental Occupational Proficiency Course - Instruction in 

competencies common to a cluster of occupations for the pur- 
pose of developing skills, knowledge,, &d attitudes for advancement 
into the next level of an occupational proficiency program 

Instructional Program Descriptions Bulletin - An inventory containing 
a descriptive analysis of vocational programs offered in Florida 

Integral - A term which qualifies some element or part as essential for 
completeness 

Laboratory - A facility designed to provide instruction in the use of 
tools and equipment in an occupation 

Limited English Speaking - One who cannot effectively communicate in 
the English language 

Manipulative Skills - Proficiency in handling and operating tools or 
machines, ,and in designing, shaping, forming, or fabricating 
various objects 

Occupational Proficiency Program - Same as occupational preparatory 
described below | 

Occupational Preparatory Program - A competency-based program of 

instruction specifically designed to prepare a person for employ- 
ment in an occupation or cluster of closely related occupations in 
the occupational fields of Agri-business and. Nafkral Resources 
Education, Business and Office Edcation, Distributive Education, 
Home Economics and Industrial Education. 

Performance Objective - A statement of what the learner must do, in 
observable and measurable terms (same as behavioral objective) 

Pre- Vocational Program - A program of instruction designed to provide 
orientation to and exploration of experiences with the kinds and 
levels of work in a broad range of occupations 
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Program Area - The vocational area in which instruction takes plaqfr, such 
as Agriculture, Home Economics, etc. When completing the form use 
the following official abbreviations. 



AG - Agriculture 
BU - Business 

CH - Consumer & Homemaking 
DE - Distributive Education 
DO - Diversified Occupations 
HG - Home Economics * Gainful 



HL - Health 

IA - Industrial Arts 

IN - Industrial Education 

PS - Public Service 

SP - Special Programs 



Sequence - The arrangement of instruction in a consistent and logical 
manner 

Service Area - See Program Area 

Standard - A condition set as a measure or basis for comparison 

Supplemental Program - A program for persons currently employed who 
need training in order to update, or upgrade skills to achieve 
stability, or advancement in current job position 

Target Population - The group(s) who are being served by the prq§ram 

Task Analysis «r A list of operations and procedures performed by work- 
ers in a specific occupation; may include materials and equipment 
utilized on the job / 

i 

Vocational Planning District (Region) - A geographic area that encom- 
passes the boundaries of a community college district and all 
public school districts contained therein. 

Units of Instruction - A subdivision of a program curriculum arranged 
and developed in various lesson plan groups 

Vocational English as a Second Language (VESL) - instruction in English 
necessary for the occupational area 
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Program Requirements for Bilingual vocational Education in Fldtida 
School Data Sheet 



nam of School Occupational Areata], 



Language Groups Represented in Bilingual Vocational Education Program(s) 
A P 

B - E 



Number of Students in tach Language Group 

A D 

B E 

C F 

Numoer if Bilingual vocational Education fMff_ 



Respondent's Background Information 
(Response Optional) 



Name 



Position Subject Area. 



Language (s) , other than English* spoken : 

{check one) Oral Fluency s Native Good fair Poor 
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Program fre.rjir extrnrs Cor Bilingual /ocaticnal Education in Florida 



Th# purpose of this phase of the study is to identify the addi- 
tional staff skill, facilities, equipment, supplies, materials, and 
curriculum components necessary for effective Bilingual vocational 
Education Programs in the state of Florida. The comparison you are 
requested to make is between the regular vocational Education program 
(VBP) and the Bilingual vocational Education Program (BVEP) . 



I. 



Staff 



Researchers have studied the ratio of students to staff that 
will permit effective education of the students enrolled in the pro- 
gram, but no conclusive data was obtained. He would like you, as 
BVE personnel, to express your opinion as to the appropriate ratio 
of students to staff in effective BVE and VE programs in Florida. 
Express your opinion by placing the number of students in the space 
provided below, be sure to ica^e two entries for each item. If the 
position is not necessary place a zero (0) jn the space. 



VE 



BVE 



1. Vocational Instructor who speaks English only 1/ l/_ 

2. Vocational Instructor who speaks English and 

target language (s) V l/_ 

3. Papaprofessional who speaks English only 1/ l/_ 

4. Paraprofessional who speaks English and the 

target language (s) 1/ 

5. English- as- a-second language instructor 1/ l/_ 

6. Guidance person who speaks English only 1/ l/_ 

7. Guidance person who speaks English -nd the 

target language <s) W 

8. Occupational specialist who speans English 

only 1/ 1/- 

g. Occupational specialist who speaks English 

and the target language U) 1/ V_ 

10. Community volunteer who speaks English only 1/ l/_ 

11. Community vol un tear whd speans English and 

target language (s) 1/ ; l/_ 

1/ 



12. Others (specify). 



1/ 
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Staff Sk 



Lis 



thm •kill I that aaka a vocational edocator a bilingual vocational 
educator have been idantifiad. Wa Utould 11 kt you to express your feel- 
ing ae to.wh«thtr or not theee skills act necessary for the etaff in 
effective 8VI , but not in VB programs. Circle X * NN. or C as below . 



Necessary (N) 



Not Necessary INN) 



The skill is neceesary for staff in effec- 
tive BVEPS* 

The skill is not necessary for the staff in 
a BVEF. 



Undecided (0) 



You are not sure if the skill is necessary 
in an effective BVEF. 



Language Skills: v ^ 

Not Cn- 
t Necessary Necessary decided 

1. The BVE staff apeak and * 
understand the target 

language (a) K m U 

2. The BVB staff read and write 

the target language (e) H MM u 

3. Other (specify) N NN C 

Cultural Skillet 

1. The BVB staff is sensitive to 
students' cultural attitudes 

towards learning H NN 0 

2. The BVE staff ie sensitive to 
students 0 cultural bel4efs a-* 
bout social structure including 

faiiily and authority figures N MN u 

3* The BVB staff are sensitive to 
cultural stigaa associated with 

scewj words or expressions N NM u 

4. Others (specify) 
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III. Curnctlum 



Th« additional curriculum coupon- 
tuts MctiMcy far tf ftctivt BVE 
programs, but not for VE art: 

1* Ltngoagt iaprovantnt compontot(t) 

2. Cultural andtr standing compontnt(s) 

3. Othtrs (sptclfyj 

IV. mttr*ial s * 

Tht mattriai ntctssary for tfftctlvt 
3VE programs* but not for tf ftctivt 
vr programs arts 

1* Bilingual ttxtboo** 

2* Ttxtbooks in targtt lar^uagt only 

3. Engl ish • languagt tutorials pra- 
partd for studtnts -with Liaittd 
English Sptaking ability (L£SA) 

4. Audio-visual mattriala that art 
specific for tht occupational 
training of tht liaittd English 
spaas ing 

5* Translation of vocational tutorials 
prtpartd fcy tht staff 



Not Un- 
Stctissrv Ntctssary g dtcidtd 



?3i 



NN 



MM 



*$• Othtrs (specify) ^ 



V. facilitits. £guipmtnt# and Supplits 

Tht facilitits* tquipmtnt* and supplits ntctssary for ef ftctivt 
vocational tcucation havt bttn tptcifitd. t Tht onts ntctssary for 
tfftctiyt BVE ^havt bttn suggtsttd* would you cxprtss your fttl- 
ings as to whtthtr or not tht facilitits, tquipatnt, and supplits 
ntctssary in BvX art ltis, mors* or tht samt as thost in VE. 

1* Tht facilitits ntctssary for sf :*ctivt BVEPs art \ Circlt Qnt 
mors* ltss, or tht samt as thost for tfftctlvt VEPs. 

Of mors or loss sptcifyi 
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2. Tht equipment ntctiMry for ef f ective BVEPs art: Circle Ont 
nortf less/ ox the same as chose for effective VEPa. 



If aore or less specify: 



3. The supplies necessary for effective BVEPs are: Circle One 
aore, less or the sea* ag th0 ** for VEPs. 



If sore or less specify:^ 



VI. What suggestions would you sake for the vocational instructor who 
has sultilanguege liaited Englisn speaking students in the class? 



V 
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Questionnaire to Identify Standards and Criteria 
for Effective PUirtguel .Vocational Education Programs 



Thank you for agreeing to participate in this study and to txprtaa 
your opinion -'Hit the standards and criteria that* w*.*« aet, would 
indicate the pro /is ion of effective H lingual vocational Education 
(BVI) • The results of the questionnaire will be cstd in the develop- 
ment of the BVE component of the Vocational Education Program Review 
for the stats of Florida. 

The following Fsges contain a series of standards and criteris 
obtained from s review of the existing ME and Vocational Education 
(VE) programs. You are asked to decide whether esch standard and 
criterion, when eat, will result ih effecti/e BVE prograas. 

any feedback on itsaa that should be modified* da a ted, or 
added ia welcoat. All input froa BVE personnel is relevant and necessary 
in order to devise s useful evaluation ays tee. 

Please write any coaaents or additional itsas on the back of the 
pages, and do, not forget to write the nuaber or letter of the atahu.»rd 
or criterion nest to your coaaents or item. 

you will notice that your naae ia t .quested. Thie is done only 
in case there is difficulty in interpreting any coaaenta and we need 
to ask you for additional information. You need not give your naae 
if you do not wish to. Tour responses, along with those of others 
» > respond, will be suamerited. Thus, yocr response will reaain anonyaoua. 
There is a separate aheet with the definitiona of terse for your convenience. 

Teas X* 

JU Jtead each of tfre standarda on the questionnaire. 

B, ~ In asking your respontee, circle 1,2-3, or 4 en aeiovt 

1. Bilingual Vocational Education (SVE) ■ BVE programs srs 
designsd to provide students with skills and Knowledge 
of vocational English necessary for entry level employ- 
ment in the occupational area of i net ruction. The lan- 
guages of communication in the BVE program art English 
and the dominant language of atudenta in attendance. 

2. Vocational Education (Vgl t VE programs sre dssignsd to 
provide students with vocational akilla neceaaary for entry 
level eaployaent in the occupational area of instruction. 
The language of -omaunic*;i- - in the VE program ia English 
SfiaX* 
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Task I. B (cont'd) 



Talk II. 
A* 



3. Both BVE and VE: Tht ldantiflad standard it squally rtlt- 
vant to BV1 and VE program. 

4. Hons i Tht standard is not nacasaary for an tfftctivt 
Bvt and/or V*; program* 

It i standard ldantlf lad aa approprlata for VE only f .) or 
not approprlata Nona (4) do not rata tht crtttna ; 90 to tht 
naat standard. 



Rsad aach crlttrlon for thoat standards appropriatt for BVE 
or Both * 

Clrclt tha rtsponst that most ntarly rtprtstnts your faaling 
aa to tht dagraa to which you agr aa with tnt appropr latanass 
of tha critarion aa a aaasura of wnathar or not *-ht standard 
naa batn nt. 

In asking your raspers*** clrci* 1*2,3*4* or 5 aa balow* 

1. Strongly Agrai <SA) if tha critarion daacrlbad would 

hava contidtrtblt impact in stat- 
ing tha standard in an tfftctivt 
BVE program* 



2. Agraa (A) 



ondacldsd 



Diaagraa (D) 



if tha critarion dascrlbad would 
hava a modtrats impact in natt- 1 
ing tha stands, J in an af factiva 
BVE program. 

if you ars not aura whathar or 
not tha critarion would hava any 
iapact in matting tha standard in 
an tfftctivt BVE program. 

if tha critarion dtscribsd is not 
nactssary in Mating tha standard 
in an tffactivt BVT program. 



S. Strongly Diaagraa (SO) if tha critarion dtscribtd \ould 

hava nagativa or no impact In 
matting tha standard in an tfftc- 
^ tivt BVE program. 

If a critarion is idantifiad as Oiswa a '4) or 3tronoly Dla - 
agraa (3) 90 to <ha nast crltsria* do not do TASK III for this 
particular crltsriom. 
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Task XXX. 



A. rot aach criterion de teraine if it is appropriate for BVE 
or BOTB 

B. In aekirvg your response circle 0 or 1 as below* 

0 - Both The criterion is appropriate for BVE and 7E 

1 - BVE only The criterion is appropriate for 3VE only 

Before returning the fores* please be sure that you have responded to 
all ltesw. If you have any questions aoout this; pleaee ask the adminis- 
trator. 

Thame you for your cooperation. 




221' 



Silinguni vocational rducatioo Standards sndjbritaria 



Furponat To datarnina tha standards and crlttrla* vruch whan sat, will 
raault in sffactlva tvt prograna. 

I* sroaran Oblactivna 

Standard! (Cirela ona, if 2 ox 4 la salactad ski? to nast standard) 

1. Progran objactivaa ara consist ant with SVE VI BOTi MOWg 
vocational Zducation Frogran Couraa 

Standard* - If 10 for tha atata of Florida, 12 3 4 

£rltariat(tt 3.4 or S U salactad saip to naxt critaricn or standard) 

OaV 

SA A 0 D SO '' BOW BVC 



A* Tfca sub j act aattac in this progran 
corrasponda to tna progran daaerip- 
tion spaclf lad in tna Vocational 
education Ft oar an Coarse Standards 
for' tna ataca of Florida. 1 

B. abjactWaa hava baan written to 
cover tna subject tatter in tna 
progran. * 

Standard! 

2. Frogran ocjectivne ara eonaiatant 
with tha SV1 f « aeecifiad 

by tha najor funding aourca (fedetel* 
atata* connunity, other). 



2 3 



2 J 



BVf VI BOTH WOWt 



Crl tafias 



ORLT 

sa a o j $& * jcrn avt 



A. The subject mat tar la this progran 
eotreeponde to tha progran ceecrip* 
tlon sneeifiad ay tha najor funding 
soyrea. 1 2 3 4 S 



Objactivaa have baan written to 
cover tha suhjact nattar in tha 
progran 



1 2 J 4 S 
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II. Instructional Co ntent 

Standard: {it 2 or * is selected skip to next standard) 

BVE VE BOTH 



KJNE 



1. Courses or units of instruction in this 

prograu are based on defined or measure- 
able competencies required for employ- 
ment . 12 3 4 

Criteria: (if 3 4 or 5 is selected skip to next criterion or standard/ 



SA A V 0 SD 



A. The prog ran provides students with 
the needed knowledge, skill and 
attitudes required for employment. 

B. The exit competencies of the stu- 
dent are compatible with current 
employment practices in the field 
of training. 

C. The methods/sources that are used 
in the development of course or 
units of instruction are: (rate 
all choices) 

(1) Task analysis of occupation 

(2) Available curriculum guides 



(3) 



Textbooks 

(4) Learning Task analyses 

(5) Subject matter expert interviews 1 
,6) Subject matter expert committees 1 

(7) Observation of workers in occu- 
pational area ' 1 

(8) Special needs of students 1 

(?/ Special characteristics of 

students 1 

(10) Ot*+r (specify) 1 



2 3 



2 3 



ONLY 
; BOTH BVE 



5 i! 

M 

5 
5 
5 
5 
5 

5 
5 

5 
5 
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xx. 



Instructional Content (cont'd) 

Standard: (If 2 or 4 is selected skip to next standard) 

2. The "'Work Expat lance" pt 09 can is based B VE VE BOTH NOTE 
on identified student needs. 12 3 4 

Criteria: (If 3,4 or 5 is selected 90 to next criterion or standard) 



ONLY 

SA A 0 D SD BOTH gt/r 



A. The "Work Experience" prog ran was 
established due to high potential 
dropout rates of; 

(1) All students 

(2) United English Speaking 
students 

B. The prog ran is continued based on 
current dropout rates of: 

(1) All student* 

C. The dropou* rates are substantiated 
by: (rate all) 

(1) School records 

(2) Student surveys 

(3) Other (specify) 



Drooout rates are recorded by dom- 
inate language of the student. 



2.451 

I 
t 

2 3 4 5 ( 

2 3 4 5 

2 3 4 5 
2 3 4 5 
2 3 4 5 

2 3 4 5 



REMINDER: Please answer all *teaa for the determination of the standards 
and criteria which* when met* will result in effective BVE sioorams. 

Ill, Advisory Coamittee 

Standard: (If 2 or 4 is selected skip to next standard) 

1. The prog ran .is supported by an organised BVE VE BOTH >«ONE 
and active advisory coeaUttee. I 2 3 4 
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III. Advisory Coiwiittee (cont'd) 

Criteria' «** 3,4 or 5 is selected skip to next criterion) 



Th*. advisory ccsnittees that may 
serve this prograa are: (rate 
all coneuttees) 

(1) One county-vide comittee for 
all vocational prograae. 



(2) A specific county-wide co»- 
eittee for an occupational 
irea. 

I ) Schoul/coliege-vide advi* 
sory cosaittee for all 
vocational progress 

(4) An advisory cosaittee for 
the specific prograa only. 



SA A U D SO 



The aeabers of the advisory coer* 
eittee should include representa- 
tion froB the following areas 1 
(rate all areas) 

{4 } Employers 

(2) Supervisors h Managers 

(3) employees 

(4) roraer students 

(5) Present xtu<*-Ats 

ft) parents (high school level) 



Accreditation* licencing, k 
certification board at-ebers. 



tt> Conmi*;ity leaders 
(9) ftetirtdT Employees 
0; Other (specify) 



2 3 4 5 



4 5 



2 3 4 5 



2 3 4 5 



2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 

2 3 



ONLY 
BOTH BVE 



0 
0 
0 
0 
0 
0 

0 
0 
0 
0 
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XIX. Advisory Cow it tee (cont'd) 
Cf iuriai ? 

ONLY 



SA A 


0 D 


SD 


1 BOTH BVE 


The eeabcrship of the advisory 
coaaittee it representative oft 
{rate all) 








(X) MlUl X 2 


3 4 


S 


0 1 


(2) Ptultl X 2 


3 4 


s 


0 1 


(j) Ethnic groups livinr in the * 

un X 2 


3 4 


s 


0 1 


(4) Mess living in tti area X 2 


3 4 


5T 


0 1 


(S) Other (specify) 


3 4 




0 ly 


Tne i unctions o r . un eoviaory ccs>~ 
•it tee arei Usee all) 








(X) Identifying enployaent oppor- 
tunities for students X 2 


3 4 


S 


0 1 


(2) Arranging for student uaa of 

to— unity raaourcaa 1 2 


3 4 


5 


0 1 


(3) mcu—inding equipment and 

tools for tba prograsi X 2 


3 4 


5 


0 1 


(4) Identifying cooperative work 

sites for the students X 2 


3 4 


5 


0 1 


(S) Evaluating the program X 2 


3 4 


5 


0 1 


(il Identifying essential conpt- 
tencies for entering occu- 
pation X 2 


3 4 




0 1 


(7) Assisting in cultural under- 
standing X 2 


3 4 


S 


0 1 


(•) Providing and/or identifying 
bilingual personnel to assist 
in tne classroom when needed 1 2 


3 4 


s 


0 1 
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IV. Staff Ouallf ications 
Standard i 
1 



the progran is staffed by qualified 
ptrionMl. 



8VE VI BOTH NOSE 



Criteria! 



The progran is staffed fey quali- 
fied teecfter t /instructional pec- 
sons a 1 ia Uia following areas $ 
(rate ail areas) 



SA A 0 D St ( 



BOTH 



ONur 

BVE 




(1) vocational Education 

<?) Vocational Sducation* English, 
and target language <s) 

(3) instruction of English as 
a s e co n d language 



(4) Multicultural underatanding 

B. The teacher /instructional quali- 
fications sre validated by: 
(rats all sethods) 

(1) riorlds vc certification 
^_ (regular or temporary) 

(2} Approved by local school 
board or board of trustees 

C. The progran is staff ed by qualified 
supportive personnel! (rata all) 

(1) Culdance Counselors 

(s) English speaking only 

(b) Proficient in Englisn 4 
target language (a) 

(2) Occupational Special iat 

(a) English speaking only 

(b) Proficient in English 4 
target language (a) 



2 3 4 5 



2 3 4 



2 3 4 
2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 3 4 



2 3 4 



IV. Staff Qualification* (cont'd ) 

CNLY 



(3) Par aprof ess lonals 


SA 


A 


U 


D 


SO 


BOTH 


BVE 


(a) English speaking only 


1 


2 


3 


4 


5 


0 


1 


(b) Bilingual English fc 
















target language (a) 


1 


2 


3 


4 


5 


0 


1 



REMINDER: Please ansver tnes* items foe tha determination of tha standards 

and criteria, which *nen met, will result in affective bve programs. 



v. facilities 
Standard: 

I. The facility enables program objec- BVE VE BOTH NONE 

tives to be taught 12 3 4 

Criter ias 

ONLY 

SA A U P SD " BOTH BVE 

A* The classroom labs* ox shops are 
adequate for the instruction of 
program objectives in the following 
areas* (rate all areas) 

(1) Site 

(2) Location 

(3) Arrangement 

(4) Maintenance 

(5) Accessibility for handicapped 
students 

(6) Safety aspects 

, (?) Heating/ventilation 

(•) Illumination 

(*) Acoustics 

(10) Other (specify) 



0 
0 
0 
0 

0 
0 
0 
0 
0 
0 



? 
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V. rieilitiM (cont'd) 

» 

Criteria* 

S. sestrooee, dressing zoom, etc. 
are conveniently located for: 

(1) Nile students 

rt»ale students 

(3) handicapped studsnts 

C. ftticrooas, dreeaing zoom, safety 
directiona * cnerta ere clearly 
eaxked int (rate ssch one) 

(1) English only 

(2) International symbols 

(3) Target language (a> only 

(4) English t target languageU) 

VI. T^trugtion^l »eeources 
Standard: 

1. instructional rasoutcas ara uaad to 
Mat program otjectivea 

Critariat 



SA A U D SD 



BOTH 



12 3 4 
12 3 4 
12 3 4 



12 3 4 
12 3 4 
12 3 4 



1 2 3 4 5 1' 



VE 



1ft * q 0 » 



Tha prograa baa tha following in- 
structional resources to attain 
prograa objectives, (rata all 
resources) 

(1) Tools and equipment 

(2) vocational instructional ar- 
teritis int (rsta all) 

(a) English only 

(b) Italian s target Ian* 

gAageia) 

(c) Jar*** language (s) only 



12 3 4 

12 3 4 
12 3 4 



(d) . Consonants of English t 
target language needed for 
occupation (i.*.. bilingu- 
el secretary) 1 2 3 « 



0 
0 
0 
0 



BOTH 



ONLY 

bve 



a OTH MOHC 
3 4 



ONLY 
BVE 
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VI. Inatructional attourctt (cont'd ) 

(3) English as a ■•cond languagt 
aatarlals for occupa- 
tional ICM 

(4) Consuaablt auppliss 

(5) Salt tad lit tour eta (/quip- 
nant, livestock, human 
auojacts, ttc.) 

(f) Audio visual aatsrials 

(?) Othsr (spscify) 



SA A 0 D SD 



12 3 4 

12 3 4 

12 3 4 

12 3 4 

12 3 4 



Tools and aquipntnt in this prograa 

ax* atsilar to thost ussd in busi- 

ntss and industry* 1 2 3 4 5 

Tools and aquipnsnt havt ths nsc- 

tssary safsty dsvicts* 12 3 4 5 

If tools and tquipasnt brtsk, atr- 

vies is available to rspair than* 1 2 3 4 5 

Morn* broaen or outdatsd tools and 

oouipntnt art rsplacsd 1 2 3 4 5 

instructional natter ials in this pro- 
gran art nondiscriainatory in conttnt 
toward: (rata all) 

(1) Malts 1 2 j 4 5 

(2) rtaalta 12 3 4 5 

(3) Sacs* 1 2 3 4 5 

(4) Handicapped 12 3 4 5 

(5) Ethnic group* 1 2 3, 4 5 

(6) lit* ttd r English Speaking 1 2 3 4 5 



ONLY 
BOTH 8VE 



0 1 
0 1 
0 1 



JUMlimu tleeae answer thtat itenn for ths da tarsi nation of ths standards 

and criteria* which vhsn sat* will reeult in sfftctivt bve 
prograns. 
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VIZ. aecruitaent 
Standard: 



Tht prog ran provides an active recruit- 
ment prograa for students. 



BVE VE BOTH NONE 



Criteria j 



SA A U 0 SD 



A* Orientation sessions are held to 
acquaint students with the program. 

(1) Multilingual staff participate 

in recruitstent prog ran l 2 3 4 5 

B, Printed information is provided 
to acquaint students with the 
program 

(1) Printed material is provided 
in* (rate all) 

, (a) English only 12 3 4 5 

(b) Target language U) only 1 2 3 4 5 

(c) English a target lan* 

guage(s) 1 2 3 4 5 

C Cl— unity resources that are used 
to provide inf or nation to pros- 
pective students 

(1) The co— un ity resources that 
are usedt (rate all) 

(a) Radio t TV 

a.l English only pro* 

oraav 1 2 3 4 5 



acta 



ONLY 
BVE 



a. 2 Target language 
prograe(a) 

a. 3 Both English and 
target language 
prograa(s) 



1 2 3 4 5 



1 2 3 4 5 
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VII. Rtctult— nti fcottt'd )> 



(bf Navspapors * 
u b.l English langungn * 
^ f only 

b.2 Tar gat language a) 
^ only ^ 

T 

b. 3 loth English and 

- tar gat iangu*^«<») 

{d Social Organisation 

c. l aoelal tarvlcat 

agsnciaa 

c.2 ethnic Cluoa . 



D. All studants ara ancouragad to an- 
tar tha program (rata all) 

(1) Mala 

(2) Paula 

% ' 
(J) Proa atonic groups living 
in tna art a 

(4) Pro* racaa living la tna 



(5) Lin i tad Engliah Spaak- 
1«9 



V 



(4) Randieappad 

VIII. Adaiaalona 

Standards 

Admissions procad 
ara oparational 



SA 


h u 


0 SO I 


BOTH 


BVE 


1 


2 3 


4 . 5 


0 . 


1 


1 


2 3 


4 • 5 


0 


1 , 


1 


2 3 


1 > S 


0 


1 


1 


2 3 


4 5. 


0 


„ 1 


1 


2 3 


4 S 


0 


i 












1 


3 3 




0 




1 


2 3 




• 0 




1 


2 3 




0 




1 


2 3 




0 




1 


2 3 




0 




1 


2 3 


k ! 


0 










V 






BVB 


vc 


BOTH 


NOME 




1 


2 


h 


4 



ONLY 
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VIII.. JcTiasions icont'dj 
Crittf ias 



A. Academic prerequisites 'are speci- 
fied for st-dents in: (rate ili) 

^ (1) English only 

(21 



SA A L' P 



SB I 



■^araet 1 j". iuaae seine 
Ingiisn uncwleage 



(3) Sr.alisU ?1js sorre *no»ieuge 
oi x.fc * language 



3-ageii, 



.aageis, oniy 
target lan- 



3. Students encored in the prograa 
are at f-rcpet jrade level as 
specified m tne Course Zed* Di- 
rectcry-Puolvc Schools 19B0«-81 

C; The admission procedures are de- 
veloped byi (rate all) 

ll) Adrunisttatori 

(2) Counselors 

(3) Teachers 

(4) School support personnel 
{5} Parents 

{6, CoTitun^ty representatives 

(7) Other t specify! _ _ 



1 2 3 

1 2 3 

1 2' 2 

1 2 3 



, . ONLY 
30TH3VS 



1 2 3 4 5 



12 3 4 

12 3 4 
1,234 

* 2 3" 4 

12 3 4 

12 3 4 

12 3 4 



0. Teacher's) assist m the selection . 

' of students «fco enter the prograa. 12 14 



o ■ : 

G 1 



ii 



9 
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la 

v. 



VJll . Admissions f con't) 



r 









SA 


A 


U 0 


SD* 


' SOTH 




* 

B. 

» 


The criteria used for student 
admission into the %ioric Ex* 
parlance" prcjraai are: (rata 

ail) 1 








* 

K 


t 
i 








Truancy problem 


1 


2 


3 4 


8 


* 
0 


1 




(2) 


Need vox ft in order to con- 
tinue education • 


1* 


2 


3 4 


s 


! 

c 






(3) 


Deprived economically 


1 


2 


3 4 


„ 5 


0 


i 




• 


Seqacive attitude toward: * 
(a) worft 


1 


4 
* 


3 4 


5 
f 


0 , 


i ft 






{by school* 


* 


2 


3* 4 


ft 

5' 


0 








(c) society 


1 


2 


3 4 


c 


-0 * 


1 




(5) 


Poor, self-concept 


1 


2 


3 4 


S 


0 


1 






Alienation 


1 


2 


3 4 


. 5 


- 0 


1 




(7* 


Discipline problem 


1 


. 2 


3 4 


5 


'- 0 


1 


\ 


(8)' 


Half-day perforner {limited 
attention span) 


1 


2 


i 

3 4" 


5 


0 


A 




(9) 


*0ver-aee in grade 


1 


2 


3 4 


5 . 


0 


1 




(10) 


Not relating -to claasworft 


1 


2 


3 *i 


* $ 




1 




(11) 


-Lacft^of mtereet 


• I 


2 


3 4 


5 


0 


I 


4 


'(12) 


Other isgmc'ify) 


1 


2 


3 4 


S 


0 




r. 


Teachers work wi tn Student Ser* 
'vice personnel to provide student* 
•with information about occupation* 


1 


2 


j'« 


s 


V 




0. 


Students service personnel help 
develop flexible schedules to neat 
special needs of *Wor ft Experience* 
studenta 


1 


2 


3 4 






1 



/ 



14. 
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IX. 



Class £nroll«wnt 
Standard t 

X. Classroom tnrollnent is luai ted to 
permit students wo atti'in the pro* 
grtm objectives* 

CrUenat 



BVS VE .BOTH NCVE 



X. 



"he anrollaant is restricted tfc 
rovide students vitt the oppor? 
t unity to obtain pre jram objec- 
tives 1 

Instruction 

Standard: 

-* 

1 Instruction 1*> organized in order 
to assist students in* aoetigg pro- 
gram objectives. 

Criteria: 

A. The siethods of instruction that* 
may be used in order for students 
to neet program objectives are: 
(rate ali.*ethods) 

Specific period of time is 
allocated to etch course or 
unit and students are expect- 
ed to master the material 
- within the time period* 

(time based) 1 



(2) Instruction is varied to ac- 
commodate individual learning 
style of studfftts. (individu- 

• .aiized instruction ^ 1 

(3) Students progress at' their 
own rate through a series of 
tasks, (competency-based) 1 



SA A TJ S' SC 5CTH 



ONLY 
BVE " 



3 4 



BVt 



BOTH ?;0N£ 



SA A U - D 3D BCfrH 



CNLY 
3VE 



2 3 4 



2 3 4,5 



2 3 4 



a> 



\ 
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Inat: :ct;cn y ( cont'd) 1 



SA A 



ONLY 
BVE 



■ 7h« languagaU) that may be used in 
the instruction orj Students are: ^ 
(rate all) 

(1) .Infrlish only* ■ 

(2) / Target language's) c.\ly 

(3) English * target language Cs> 

^ho instructional staffae* oe 
co*poee4 of x (cat* all) , 

" (1) Vocational instructor wno 
speak* only EngM»J} 



f 4 

3 4 
« 



12*34 5 



~T2) vocational, instructor who speaks 
Cnomh 6 targe>--rervguage(s> 



1 2 2 4 5 



1 2 



(3) vocational i^structo*' 
who speaks English only ft a para- 
professionsl, who spea*s English 
y target language <•) * 1 

(4) vocational instructor fc * par i- 
profes*i<?nal who 5peak English 
4 targ#t language 4 •) ** 

(5) vocational instructor who speaks 
English purest lan-juaoefa) • a 

* paraprofeasio:~l spesking Eng- 
lish only 

The evaluation aatnodo levies that aay 
bo ass for tha #roora* acsVuate all) 

(i\ A-studeht's performance is compared 
with tfiat-di other students 
<nore)-ref*renc«) .12 

12) A atudent'i psrfornanca i* com- 
pared with a pradatarxined scan* 
jfcrd (criurion refartnee) 1 2 

* 

'(3) A prettst/poattast is givan to 
determine individual student 
achieves*** 1 2 



2 3 4 5 



3*4 



1 2 3 4 5 



3 4 S 



3 4. $ 



3 4 5 



■ 1 



0 

ERIC 
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X. Instruction (cont'd ) 



C. Student «orgamxa t ion activities 
art included in the prolan's 
instructional component. 

P. 1toe vocational student organ- % 
izationa ate supporteo cy 
budgeted school funds. 

C* Cooperative or on- the- 300 in- 
struction is provided for all 
stud ants nhan needed. 



3A * C 



SD 1 



ONLY 
BOTH 5VE 



2 3 



4 5 



2 3 



\ 



RLMIUOW: ?laasa answer tnese i tarns ^or tht attar»inat;on ot tht stan- 
r dards and cri'.na natdad for* .an effective 3 VI pro^ra*. 

XI. Student JoO Placement 

Standard: v 



* . 'placement itrvicta .art provided to BVE ft BOTH 

r 09 ran completers and/or ltavtri 12 3 



NQNI 



Criteria: 



A. Tht placement of studsnts is tha 
responsibility of : (rsts sll) ' 

(1) vocational instructor 

(2) Cooperative education in- 
structor f 

(3) Guidance counssiot 

(4) Occupational specialist 
thigh school onlyx 



(S) Student • 
(4) Director 
(?) Other (specify). 



SA A 0 0 SD 



2 3 



0 

CHVt 
30TH *3VE 



0 
0 

0 
0 
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XI 1 . Student Placement {cont'd) 



SA A U D -sa 



». The placement pt ^students who 
complete or leave the program is 
further assisted by the follow- 
ing agencies: (rat**- all) 

(1) Florida State Employment 
Serv ices 

(2) Advisory Committee members 

(3) Potential ewplcjyers m bus- 
iness, and industry 

(4) Ethnic group organizations 

i5) Othera ( specify) ' 

C. Aid for placement ;s provided for* 
f program laavera and complatera • 

(9 Aid ia provided for: (rate 
all) 

(a) Miles 

(bf ^Pen>alea 

tc) Member rumor: ty ethnic 

group 1 f 

(d) Minority race mencer 

(e) • Limityed ^English speaking 
(f \ .nana l capped 



2 ft 

3 4 

3 4 

3 4 

3 4 



BOTH. 



OKU 
BVE 



0. Organized experjeno* in the labor 
marxet is provided to meet program 
oo^ectivea (Work Experience Pro* 
gram) 

iU parent and employer training 
agreements are available for 
each student « 1 



(2) All 



sViden 



ts in program work 1 



(3) The program operates in ac- ^ 
cordance with state 4 federal * 
laoor laws 1. 



2 3 4 
2 3 4 

2 3 4 



S 



0 

c . 

0 ' 
0 

0 



> 



J 
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XI. S t>idtrnt Job Placement (cont'd ) 



■;4) StuJ*^* assignments to 
employment actions are 
witnout bias .towards: 
(Work Experience Program) 

(aj aiil« v 



A I? D SQ • I ? OTH 



(c) 



female 

ethnic group 



(J) race 

,.<•) lixited English spean- 
in^ ability 

<f> other (specify!^ 



(5) 



Student progress folders are 
availaole to placement staff 



(6) Student placement folders are 
available to placement staff 

XII. S tudent, follow~jp 

Stand ird: A 

1. Data from follow- op studies are used 
to make decisions regarding curricu- 
lum and program revision 

Criefcria; 



BVE 



0 
0 

0 

! 0 

r ° 

o 



5 1 ' 



BVE Vt BOTH SONE 



2.3 

4 





( 


» s* 


A 


U 


D 


SD 


ecpf avx 




A* 


Students are informed of the im- - 
















portance of foliow-u^ studies 1 


2 


3 


4 




! o i 

! 




3. 


Students are informed of foilow- 












• 


41 


\ procedures 1 


2 


3 


4 


5 


0 1 




9 


l\achers/instructocs receive place- 
















mint fc follow-up information each 
















year for the purpose of: (rate all) 


A 














(1) Making program changes 1 




3 


4 


S 


0 1 






(2) Sharing with school/college 












• 




administrators 1 


2 


3 


4 


S 


0 1 












• 







9 
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XZZ. Student Foliow-up (cont'd) 

* / 

t 

(3) Sharing with Board of 
Trustees (C.C. Level 
only) 

(4) Sharing with Advisory 
Committee- 



<7 



. ONLY 



SA A U 0 SD * BOTH S'/E 



1 I 3 4 5 



12 3 4 5 



1 2 3 4 5 ji 



3-4 5 l! 



(5) Sharing with students cur- 
rently enrolled in the 
program 

v C. Teachers assist in contacting 

former students 

XIII. Administrators and Sbp&rvisors 

standard: 

y 

' A-^tnicrrarnrs srd/nr -.Jpi»rv : wr-; pro- . PVT vr K JC % J r 

— vide assistance in program main- 

4 tenance and improvement. ' 1 2 3 4 



Criteria: 



SA A U D 5D 



A. The administrators and/or super* 
visors who provide the assistance < 
are; (rate all) 

(1) Dean of Instruction (C*C. 
only) f 

(2) DearVDirector or Occupation- 
al Education (C.C.only) 



12 3 4 



I 2 3 4 

(3) Program Leader (C.C.only) ' 12 3 4 

*{4) Local Director of VE 

(high scnool only) 12 3 4 

(Si ' County level Vocational 
Supervisor (high school 
only) 12 3 4 

(I) School Pr i rue pal or Dir- 
ector (high school only) 12 3 4 

(7) Other (specify)* 12 3 4 



CNLV 
BOTH BVE 



0 
0 



A . .. 
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XIV. Sta Cf improvement 
Standard: 

1. The opportunity for professional 
improvement is provided iV^accpr- 
dence with staff needs 

Criteria; 



BVE VE BOTH NOME 



SA A I' 0 SD 



A. The staff development needs 
of those responsible for 
the program are assessed in 

the* following areas: (rate all) 

(1) Cultural understanding 

(2) Vocational update 

(3) Foreign language skills 

(4) English language ski lid 

• . ; r 

(5) Other (specify) * 

B. freer vice, staff development 
workshops are provided 

C. Inservice administrative de- 
velopment workshops are 
provided 

0. Local funds are provided for 
travel to teif -development* 
activities ' 



2 3 4 

2 3 4 

2 3.4 

2 3 4 

2 3 4 

2 3 4 

2 3 4 

2 3 4 



ONLY 
BOTH BVE 



^ Additional Conwentf are welcome: 
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. EVALUATION CF BYE/v*ESl PROGRA*' REVIEW COMPONENT 241 

i 

DIRECTIONS: , reaponat that most nearly repraaenta ycur feelings aa to tr«e 

appropr latanesa cf the atandard and its criterion foe evaluating tr.t f f f ect iveneae of 

avE/VESL pro^rairs in t.ie atate of riorjda. Ma/e any additional cemmenta in the spact 
provided or at tne end of ttui instrjaent. The Standar J/Cr ;ter la ;s appropr i*te" for ; 

TBoth) Not 
{ 1 BVE k VESL 2 #a VE only _3 VESL only ' _4 Appropriate Conunente 

A _ Acceptable met M_Mtni*ally wet, needa improvement N Not met 

> 

Standard I. , , - 

1 ' ' 2 3 4 



I 2 • 
A M J N 

Standard IX. 



4 ^ 



a- l 



A % 

Standard III. 



A. 




1. 1 



2. 1 



3. * 



. 2 
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Cgiiege ot E<!uv.i:ion 
IX* par r mem ot Eduv.u.orui 
U-^Uorihip 

Ktinjcitjfi.if Ad..u'iiiJrati *n 



Tlic Florida Sta*e I'niversity 
Tallahassee. Florida 32306 
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As per our conversation on March , 19&1/ I am enclosing a copy 
-of the field 'test ot the Self-Study Program Review forms for programs 

with Limited English Proficiency (LEP) students. These are p/ograms 
^identified as Bilingua> Vocational (BV) , Vocational English as a 

Second Language (VESL) with traditional Vocational Education (VE) and 

traditional MDcational Education with LEP students -and no VESL 

component. ' A 



Please complete the enclosed program review form for your program(s) 
and return, it to me on March\ 1981, when I will be in your school to 
conduct the oirsHe segment of the program review.' J* you flave any 
additions', deletions, or modifications please write them on the form. 
When we meet for the on-sit£ segment ot this>stu<fy r I would appreciate 
the opportunity *to di^cfuas your recommendations and/or suggestions for 
the fdevelopment o£ an efficient VE program review instrument for programs 
with LEP students. ^ ^ 

* I look forward to seeing you in the Kear /future. 
>for your cooperation and support. KJ 

Sincerely*, 



Again, 



^hank you 



Mary Anna Marangos 
Research Assistant 



/jks 
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College ot EciuC4t.cn 
Department of Eduvauonai 

Leadership 
Vocational Education / 
206 South Woodward 
(904)644-6298 



The.Flor.da Suy University 
Tallahassee. Florida 32306 
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Your proqram has been selected to be a fi?id test site 'for the develop- 
merit of a' component to the Vocational Education Program Review for the state 
of Florida ^and permission obt^ned from your administrator 
Thi$ component will be for vocational and related programs* with Limited . 
English Speaking (LES) students*, For the success of th^s project your coop- 
eration is most importapCTv Jn anticipating your willingness to cooperate 
I have enclosed a copy/of tne Self-Evaluation form intended for the 
administrators/iastructors of tnese programs. ' . 

Please complete the enclosed form for your program, and return it to \ 
me on Marc£ lgBl, when I will be at your school to conduct or schedule 



the op-site progtAffrscfeview* If you have any additions, deletions, or 
suggestions please Write them .on the form. When we meet for the on-site 
conference, I would like to discuss your recommendations and/or suggesti 
for improving th?e component. 

, *I lock forward to your cooperation. 

Sincerely, 




Mary A. Marangos 
Ftfese^rch Assistant 



/jks 



A FIELD TEST 



THE VOCATIONAL EDUCATION- INSTRUCTIONAL PROGRAM REVIEW 
iVtHE COMMUNITY COLLEGE AND ADULT EDUCATION CENTERS 



>ROCR^Hg^J 



IN FLORIDA FOR BILINGUAL VOCATIONAL PROG 
VOCATIONAL" ENGLISH AS A SECOND^ LANGUAGE PROGRAMS , AND 
VOCATIONAL EDUCATION PROGRAMS WITH LIMITED ENGLISH 
9 PROFJCIENCY STUDENTS 



iQformation for Completing Z elf-Study Form 



F.S.U. Vocational Education Study 
Document No. 4 
MAK - 2/81 
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r 
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.WHAT IS THE VOCATIONAL EDUCATION INSTRUCTIONAL PROGRAM REVIEW? ' 

In the present cfcse, tr>e researcner is adapting program review pro- 
cedures to programs with Limited finglish Proficient ( LEP/ students 
enrolled. Thus, no statt wall be /involved m thi£ review. The influx , 
of LEP students 'into the >ducat lcrfal system of Florida has presented 
a new dimejs^on to vocational education. The needs^f the LEP.stu- 
" * dents are *n 'certain aspects greater than thoseof the English speaking 
students.' The state of Florida, in order to meet the needs of all its 
student, has authorized the reexamination of the vocational program 
* review instrument. 

The following pages contain a program review instrument designed, to 
determine whether or not the nee^s of the LEP students are being met 
1 . in vocational programs that they are' enrolled in. The researcher 

is Requesting that you, as an instructor of LEP students, complete the 
instrument for your, program. In addition, please make any additions* 



your, 

deletions, or modif i>g$$3)ons you feel necessary. 

In ics usual form, program review is a joint evaluation of" individual 
'vocational education programs by instructors,, school administrators, 
and regional program consultants. The purposes of such a review ate 
directed -toward insur ing that vocational instruction: (1) meets the 
rieed^r-mterests, and abilities of students; (2) satisfies the require- 
ments of the occupation or occupational' field in which the training 
is given; and (3) meets the requirements set for it by the state Bo^rd 
of Education for the operation of vocational education programs. 

WHY ARE TH: REVIEWS OF VOCATIONAL PROGRAMS CONDUCTED? 

The primary purpose 6f program review is program improvement.' Pe- 
riodic .evaluatitfh is an excellent meajns of assuring that corrective 
' action *is taken as problems' arise. In addition, there is. the contin- 
ued emphasis throughout the educational community on accountability. 
The Florida State Plan for the Administration of Vocational Education 
under the Vocational Amendments of 1976 contains' previsions for pro-; 
gram evaluation. . The program review process is a standardized 
procedurs designed to meet the needs and requirements of local, state, 
and federal agencies. • * 



HOW WILL THE PROGRAM REVIEW FIELD TEST WORK? 

The researcher will provide the local Bilingual Vocational Education 
(BVE), Vocational English as a Second Language (VESL) , Vocational 
Education (VE) educational agency with program self-atudy forms. 
These forms list the standards which will be verified by the researcher 
during a later on-site visit. A^eview fcfrm will be completed by 
the BVE/VESL/VE staff. The field test self-study form is designed to 
assist the researcher in developing thf final version of tne BVE/VESL^ 
, VE Program Review Component for programs with LEP students in the state 
of Florida Vocational Education Program Review. 
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HOW WILL THE PROGRAM REVIEW "I ELD TEST BE EVALUATED? 

The BVE/VESL/VE itaff who respond to the program setf -evaluation will 
also revrew the contents of the instrument for its validity in eval- 
uating BVE/VESL/VE "programs with LES students in the state of Florida. 

tjhat portion of the study will'provide the participants with the oppor- 
to make ^additions, deletions, and modifications to the standards • 

t and criteria previously identified^ 

ON-SITE VISIT • ' 

After the self-study forms are complete^ the researcher will make a 
scheduled visit to the educational agency to conduct a verification 
of the self-3tudy review with teachers involved in tne particular 
programs. . ' * 

The roajqr aims of the on-site visit are to determine the extent to 
which the report reflects actual conditions in the institution, and 
to supplement the self-study report with additional data and 
documentation. 

Points covered by consultants include: ) t 

1. Obtain rationale for ^recorded answers 

2. Review evidence 

3. " Allow opportunities f (^-additions and/or revisions 

4. Assess quality above^Snd beyond what is recorded on the 

% self-study form , . ' 

, 5. Relate findings to teachers in a* developmental and k 
constructive vjay 

Working from self-study forms and in direct confetiltation with the 
teachers) involved, the researcher will complete the working copy 
of the BVE/VSEL/VE' programs ( 

After completion of the on-site visit, and exit conference will be - 
conducted with the agency head and ^.ticipating staff \o discuss 
tly results of the review. 

The major aims of the exft conference are to: 

1„ Determine the validity of the identified standards and cri- 
teria fqr BVE and/or VESL/VE programs with LE? students in 
the- state of Florida; 

2. Determine discrepancies in the interpretation of the standards 
and criteria by the instructors apd/ot researcher.^ » 

3. ' Determine if the program review instrument and data reviewed 

- provide some assurance that the program is or is not effective 

4. Review suggested modifications, additions, and deletions with 
staff. All responses, including suggested changes, will have 
been summarized, with those of others who responded. Thus*, -the 
individual respondents will remain anfinymous. 

- 308 
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PCST-VISIT ACTIVITIES ' ' ' 

An ocal report of tne ^'ta^tam reyiew bindings may oe made* to the 
educational agency if s-jch a report is requested by -r.e pre-revi 
' negotiations. 

WHO -IS' RESPONSIBLE .FOR THE VARIOUS PHASES CF THE PROGRAM REVIEW PROCESS? 
Phase I - Pr6gram Seif-Sfcudy 

Researcher % ^|uden*ify institutions and programs to be reviewed 

V ■ * 

o Submit plan and timeline for accomplishing gcal3 

o Arrange and conduct a planning conference with edu- 
cational agency administration to determine the 
^ schedule for on-site visits and the establishment of 

reporting procedures 

" ' .0 Conduct orientation for educational agency staff and 

providif in-service 'training on the use of instruments 
if requested by the head of the agency 

' Local Educational o Plan afid conduct self-study program review and return 
Agency , v coicfpfceted self -study forms to Researcher 

Researcher o Review the completed self-study forms and other data 

relating to tfce program following on-site visits 

Phase II -On Site Visit SI 



Local Agency o Make all necessary local arrangements for on-site visits 

• o 
Researcher ^ o Conduct an effective on-si€e verification of the 

self-studv review v 

> '* 

HOW WILL THE FIELD TEST OF THE BVE/ ESt/VE PROGRAM REVIEW INFORMATION 
BE UdS?, 

o The data will be analyzed to determine the validity of the 
instrument in determining if effective education ,is being 

provided to the LEP students ^enrolled f "\ 

o The data will be reviewed to determine the reliability of 

the interpretation of the standards and criteria by participants 

o The data will provide the information necessary for developing 
the final version of the .BVE/ 1SL/VE Program Review Comppnent 
for program with LER students for tne -.Vocational Education 
Program Review for the state of Florida 
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SUGGESTED EVIDENCE ?OR~$TANDARDS - REFER TO NUMBERED ITEMS IN SEL>- 
STUDY INSTRUMENT FOR OCCUPATIONAL AND COMMUNITY COLLEGE PROFICIENCY^ 
PROGRAMS 

e 

Standard 1 o Written ..program objectives 
o DOE Program description' 
o Course description 

o Written cour'se description that is provided to 
students and parents 



Standard 2 



o 
o 



Written program objectives * ^ 

Co^r of funding source standard specifications 
C^ttse description - 

Written courserdescr iption that is provided to 
students and parents 



(a) English ^ 

(b) Tar<yjt language (s*) 

Standard 3 o Course outline for syllabi 

o Defined performance outcomes 

o School procedure for modification" of performance outcomes 
o Criterion-referenced measures for each defined performanc 
outcome 

o Task analysis (es) of occupation (s) for which the program 

is designed 
o Curriculum guides 

o Tfcxtb^oks and other resource materials (English and/or 

Target Language (s) 
o Manpowe© studies 
0 Dictionary of Occupational Titl^ 

Standard 4 o List of advisory committee member (by^occupational 

position, by race, by nationality, by language groups) 
o Schedule of advisory committee meetings 
o Minutes of advisory committee meetings 

Standard 5 o Teacher's Certificate 

o Special permit 

o Copy of letter* specifying approval of school board 

o Direct observation in classroom 

Standard 6 o On-site observation 

o DOE Design Criteria for New Facilities (State Board of 

Education Administrative Rules) 
o Electrical outlets 
o Plumbing services 
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Standard 7 



Standard 8 



standard 9 



Standard 10 



Standard 11 



o 
o 
o 
o 
o 



o 
o 
o 

o 
o 
o 
o 
o 
o 



o 
o 
o 
o 
o 
o 

o 
o 
o 

o 
o 

o 
o 
o 
o 

o 
o 



' ' .2*57 

On-site observation 
Plan for equipment replacement 
Tools and equipment inventory 
Department budget 
On-site observation of availably materials and consum- 
able supplies 



Brochures (if available) (English, target language (s)) 
Program handbook (English, target language) 
Employment information related to business and 
industry . 

Interest batteries. (English, target language) 

Aptitude tests (English, target language) 

Achievement tests (English language) # ; 

Interview with stucfent service personnel 

Interview with selected students (LE?r 

Written justification /for those students not at 

appropriate grade level .* 

Written criteria for admission into class (if any exists) 

Written Criteria for- admission into program/course 
Brofchute (if available) (English, target languagfe(s)) 
Program handbook (English, target langUage(s)) 
Interview^with student services personnel 
Number and percentage of male and female students 
Number and percentage of students enrolled, by race, 
by nationality, and language group 
Student goals and surveys 
College catalog 

Nijmbv and percentage of persons in non- traditional 
fields 

Career resource center 
Career education program and material 



/ 



Class enrollments 
Laboratory size arid equipment 
C^s8 schedule 
Instructor schedule 



(on-si>te observation) 



Defined performance outcomes for each program or course 
Criterion-referenced measures for each, defined perfor- 
1 mance outcome 



o Topical outlines 

o Skill charts (English, target language) 

o Student profiles 

o Evaluation reports 

o Vocational student organization membership roste* and 
C ^Nprogram of activities t 

o Cooperative or . on-the-job placement records 



J 
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.Standard 12 o School policies and procedures for placement 
o Placement records 
o Interviews with placement personnel 

Standard 13 o Copies of follow-up studies -or placement records 
o Written recommendations for curricular or program 

change based on analysis student follow-up data 
o Reports submitted to Board, of Trustees 
• o Examples of revised course outlines 
o Minutes of curriculum committee 

• Standard 14 o Interviews with instructors 

o Interviews with administrative and supervisory personnel 

Standard 15 o Staff development surveys (with special needs component 
for LEP teachers, cultural, languages, etc.) 
o Instructor's individual plan for .stjff development 
o In-service components ' 
a o College staff and program development plan and report 

GLOSSARY OF TERMS* * 

Advanced Placement - Acceptance of a student in a program at a higher 
level than usually assumed by entering 3tudents 

Articulation - The relationship of an instructional program at one 
level to similar or related programs at another level 

Bilingual Vocaticnal Education (BVE) - BVE programs are designed to 

provide students with skills and knowledge of English necessary for 
entry^ level employment in the occupational area of instruction. 
The languages of communi c;aL:on in the BVE program are ENGLISH and . 
the DOMINANT LANGUAGE of the student^ irt attendance, 

CCD (Course Code Directory^ Code - The number code corresponding to 
programs and/or course offered in Specific area or fields as ' 
outlined in the 1980-81 Course Code Dir* tory 

Competency - The ability (including knowledge, skills, and/or attitudes) 
to perform e .specific task or duty successfully 

Coordinating Council - A group organized to' review total vocational 
education, adult general education, and community instructional 
services programs within the vocational planning district (region) 
to make needed offerings and prevention bf unwarranted duplication 

Criteria - Standards by which decisions can be made 

Criterion-Referenced Measure - A measurement device fc?ased on performance 
objectives *hich evaluates learners on the basis of' ability to 
complete a task in a given situation according to a pre-set standard. 
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Dissemination - ?f(e production, delivery, and distribution of products 
to identified target groups 

Employabilit> Skills - Human relation s:ills required to obtain and 
keep a 30b 

Entry Level Knowledge - The minimum knowledge required to function 
effectively in initial employment 

Evidences - A basis for supporting or proving response 

Fundamental Occupational' Prof iciency Course - Instruction in 

s competencies common to^a cluster of occupations for the pur- 
pose df developing skills, knowledge, and attitudes for advancement 
into the next level of an occupational proficiency program 

Instructional Program Descriptions Bulletin - An inventory containing 
a descriptive analysisLfcf 'vocational programs offered jn Florida 

Integral - A term which aJklifies some element or part as essential for 
completeness * 

Laboratory - A facility designed to provide instruction in the use of 
tools and equipment in an occupation 

Limited English Proficiency - One who has difficulty in under- 

standing, speaking, reading,. Or writing the English language 

Manipulative Skills - Proficiency in handlicg and operating tools' or 
machines, and in designing, ^shaping, forming, or fabricating 
various objects 1 

Occupational Proficiency Program -"Same as occupational ^repara-ory 
described -below * f 

Occupational Preparatory Program - £ cdfti&etency-based program of 

» instruction specifically designed to prepare a person for employ- 
ment in, an occupation or cluster of closely related occupations in 
the occupational fields of Agri-business and Natural Resources 
Hducation, Business and Office Edcation, Distributive Education, 
Home Economics and Industrial Education. 

Performance Objective - A statement of wnat the learner must do in % 
observable and measurable terms (same as behavioral objective) 

Pre- Vocational Program - A program of instruction. designed to provide 
orientation to and exploration of experiences with the kinds and 
levels of work in a broad range of occupations 
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Program Area - The vocational area'-in wh'ich' instruction takes place, such 
as Agriculture, Home Economics, etc. When completing the form, -tse 
the following official abbreviations. ( 

AG - Agriculture - HL - Health « 

BU - Business IA - industrial Arts 

CH - Consumer's. Homemaking IN - Industrial* Education 

• DE - Distributive Education , PS - Public Service 

DO - Diversified Occupations SP - Special Programs •' s 
KG - Home Economics - Gainful 

Sequence - The arrangement of instruction in a consistent and logical 
manner 

* 

Service Area - See Program Area 

Standard - A conditi6n set a$ a measure ox basis for comparison^ 

Supplemental Program - A program for persons currently employed who 
need training in order to update, or upgrade skills to achieve 
stability, or advancement in current job position 

Target Population - The group (s) who are bei|Qg serve<bby the program 

Task Analysis - A list of operations and procedures performed by work- 
ers in a specific occupation; may includei materials and equipment 
utilized on the 30b } ; 

a 

Vocational Planning District (Region) - A geographic area that encom- 
passes the boundaries of a community college district and all 
public school districts contained therein. 

r Units of Instruction - A subdivision of a progtair. curriculum arranged 
and developed in various lesson plan groups S 

Vocational English as a Second Language (VESL) - Instruction in English 
necessary for the occupational area 
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* C~CUPAT'IO'NAl PROFICIENCY ANP COMMUNITY COLLEGE 

FIELD TEST 
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DATE OF REVIEW 



ADMINISTRATOR'S SIGNATURE 



SCH0OL DISTRICT 



i 



PERSON COMPLETING SELF-STUDY 



SCHOOL 



NUMBER OF LIMTTED ENGLISH SPEAKING STUDENTS ENROLLED IN THIS PR* 



LANGUAGE (S) SPOKEN BY LIMITED ENGLISH SPEAKING STUDENTS IN THIS PROGRAM: 



2. 



PROGRAM 
AftEA 


CCD 
CODE 


PROGRAM/COURSES TITLE 


TEACMER(S) NAME* 


CERTIFICATE 
NUMBER 
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DIRECTIONS FOR MARKING YOUR RESPONSES 

On the following pages you will find a series of standards and 
criteria that may or may not be necessary for effective education for 
vocational and/or "related subjects with Limited ftKjlijfr Proficient 
Students eftrolled. You are asked to review your (program for each 
criteria in reference to its standard. 

There are no right or wrong answers , so do not hesitate to 
respond to* each statement /exactly' *as your situation is. 

Directions: 

A* In' making ypur responses place a check in the column tha . 
most nearly represents the program you are reviewing. 

1) Yes —the criteria is met in this pfogram. 

2) No — the criteria fs not met in this program. 

3) Not Applicable (N/A) —the criteria is not appropriate 
for this program 

4) To Some Degree — the criteria is not completely met. 
. 5) Used —the method is used in this program 

6) Used to Some Degree — the method is used to some degree, 
but not always 

7) Not Used —the method is not used in this program 

8) Do Not Know — you do not know if the criteria is met 
for your program. , 

B* In the event that your situation is not described please 
v make any comments in the space(s) provided or^on a -separate 
sheet of paper. 



•.tjCATUWL EDiiCATI J% i?:STRtCT:-;."iL PVtirM TOucJ 

;cc.?Ancr!Ai pRCficiiiCY h?;2 comity ::l:ege 

o 

^OGRAM 02J£CT1VES **£ JCNSISTEVT WITH THE VOCATIONAL 62UCA7ICN Fi»C6RU 
COURSES STANDARDS - 1530 FOR DETERMINING ELIGISlL.'T* r O» -T£ FACING 

tES *iO 

A. Ouaa cM'suoiwt natttr in can .-»r-jgr*« correspond to che proqras 
description apeoified in vocational Education Program Count 
Jtand*r<:a~i*IO for deteraining eligibility 'or weighted ITS 
f undirw? _ 

a. Have oojective* ceon written to cgver tne *uc:«ct sstter in 

till i pr ogres? _ 

PROGRAM OBJECTIVES ARE CONSISTENT WITH ^HE «TAHlUPn$ AS SPgCIPIg^ 

BY THE MAJOR FUNDING SOURCE (FEDERAL CfWlT, STATE, 0>£3J 4*ip w III. 
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A. Ths funding for this progrsn is provided byt Opacify).. 



Y£S ..0 

**• Tna subject in thie progrea correeponde to,ut propria Jsscrip- 

tion sptcU f|£ J^r the asjor funding source. 

£ Objective* novo be** written to cover cht suo^tct natter in the 
prograan 

:gurses or units cf instruction in -this program are based on defined 

OR MEASURABLE C0r«T9CIES REQUIRED FOR E3VL0YWT 

rrs *> 

A. ttw prograa. provide** atudente with ths needed knowledge, skills* and 

attitudes required for eaeioyasnt. 

0. The esit coaostencie* of the atudant ara tnoaa neceaeary for «»- 

pioymant in ens field of training. _ 
* * USED 

* TO iOME riOT 

usso occare usu> 

C. Tha sathode/eourcee that ara ieed in che development of * 
courss or unit* of instruction are: 

I. Tssfc analysis of occupation _ 

* 2. Avsiisols curriculum guidee " .. 

d 

3. Teat book e _ ^ B 

«. teeming tae* analyse* 

5. Subject utter ax part interviews — — 

I. Sub: act asttsr expert coaaittsee 

7- Cbeer/etion of work ere in occupational araa mmmmm m J m 

I. Special assde of students tmmmm _ 

9- » special ch*:sct*netice of students _ _ _ _ 

;a. otfto* tspocifv) 



THE PROGRAM IS SUPPORTED BY AN ORGANIZED AND ACTIVE ADVISORY COMMITTEE 

YES NO 

A. Coat true program have an advisory coaalttss? (If no 90 to sac t ton V* 

i. If £f{ what kind of advisory cossuttta aervee thie program? 

^_ 1. a specific county-* Ida cossuttaa for an occupations! aros< 

^_ 2. SchooX/cellaca-wida advisory ccauittM for sll vocations! t 

H proorsM. 

\. % As advisory cesanttss for this apacific peoqeaa only. 

. «. otnar (Ipacify) 
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Tr.m itu.-i: »t . .* c*i***t*j » • pi % *<-''. .^n fcsa :\a 

laiiowtn^ # :a«c* tj-.at .»-f4/< 

'i. tappers * c - r««cn«r« 

2. Supac/isocs *rd .H4n*q«§ ' .1. Cthtr apacifyl 

3. £»piOy«t« 

4. foraac stjdants 
3. Prssant studsnts 

_ 4.* ?srsnts .'aicji school Isval* 

7. Accreditation. licsnains. «nd cartif ication xucd MAbui 

_^ 4. Cooounity *s*dsrs 

_ ^^comistrstors 

0. The — bccsaip oi ths Advisory conaittse is reprsssntstivs of; Icnsc* sll 
tut Apply) 

I. Mali* *• Hsndicsoosd 

_ 2. resales 7 - otnoc specify » 

1. St&nic icoups living in ens scss *• 

4. JUcss living in Uis scss 

5. Sucject asttsr sxperts 

7, Ttit PROGRAM IS STAFFED BY QUALIFIED PERSONNEL 

a. rhs itoqitm is st^XIvd ^Aiiiisd rs*cr.sr 's},*;r.st?-ctcr.sS 
/^in Us following ifiui icnsck a!> tn*t Apply) 

^ 1. VocAtional education c 

2. /oca t loot 1 CduCAtion* English, snd tsrgst UnguAgtU) 

1. trw^isii so s Second Unguags ;C5L) instruction 

4. ?SL 11 lingual psrson in tsrgst Unguags ts) > specify) 

S. v.ui^cuitursl understanding 

g. ?h« teacher /inetruetional qualification* srs vaUdA\tsd by: (ChecK sll that 
spply) f 

_ i. florid* vt Certification (tssiporsry or stsndsrd) 
2. Approved by local acboolr board or ooard of trustees. 

. 2. ftegulea or teeoorsry Florida "aechar's cert if ic Ate 
vita other than epprupfiAte coverage* naa *et sll 
occupational especisnce requirements prescribed ss s 
prsrequieite to eppropnete csrtificstlon. sad been 
Approved by too scnool ward to teacn out-ot> field 



rour prbgreo lp staffed by qualified supportlvs parsonnsli 
At skip to VI, if 11$ or TO SOKE 3gS*et cnec* all that 
Apply 4 

_ 1. Guidance Counselor <s) 

s. Proficient in drills* sad targat laoguaga(s) 

_ 2. Occupational Specialist {si 

a. fToflcieat la Enqliaa snd target languege<e) 

J. ParaprofeeeieaalU) 

a* Siliafual in Knells* snd target lenguaoe(s) 



79 SOHE 
yES OfCaXE NO 
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3 . m.koc-., ^...i^ioo-. m- «■ co«v.»i.ntay loc.too 
and iMy w -*« by* 

1. lull ittMitntt 

2. nyotcftUy h*iuJ;c*pp^ ttuciifttt 

A..««M, JrtMinq r«— dilution. **d ciu«t. «. 

a. lofUth only 

c. MUM wd tJt9tt ItffuHK" 

d. xntirMtloAAl lyMeli 

■. :tn«( {•poci*y> ■ ■ ■ ta 

VII. IHS^ICM.K^™^™^"*""'*'**™ 

' i«.«uction*l Mt.ri.1. lft < 
_!.» enaiiin only 

i 

). t ?u«it Unau»oo:»» 3 nl * 

T M«£ tor option <..,.. fell.*** 
MCKittryl 

prO*(M. 

C A** *U«*i ilf NO » 4.,, if YM or 

TO K*» WCAEf chock OM) 

m _l. Itnylltn only 

2. Kfltlttn unit Unau*M<t> 
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TO «™i 
^£ PEC?££ 



~ 



a. inatruc.icnai. umuii .n tr.i» pcu{f^» 4tt n-n- 

1. y*laa 

2. rtMiu 

3. Ntfll 

"4. Handicap*** 

5. Ethnic Croupa 
. t. Llauted tngliah Spoekin? 
Tew it and Equipoant f 

«. Tool* and equipment io tnia proqra* *ra aiailar 
to thoaa and 1« buainaae and industry 

b. Tool a and aojuiptont nava ttia MCMNiy aa<aty 

c. If coo la and aquipmant braa*. aervlca la avail* 
ao la lor rafoxta 

d. Wotn. sioma. oc uutoatad u*>la and tqulpoant 
axa rap lac ad 

Conauaaoia aufpliaa 

ftalatad raaourcee (aquipoent. iivaatoc*. huam ouh- 
jacta. ate. 



$. Othar tapacify).. 



VIII. RKaulTWBd AJ© ORIEW^ION mXHXflES AM OPERATIONAL 

A. Cnantatlon soeaiona ara hold to acquaint atudonta with 
cna proorao it»o« AaniWOd (If Ng or akip ro 11 

if or &g amg «*• th-t *« 

tha orientation arai iChact all tnat apply) 

1. fiuidanea paraonnel 

2. vocational inatructora 

J- MultiltBoual ataff 
4. Othar (a»oeify) 
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trintad ei lentatlon aeteriala ara provided to tha prospec- 
tive atiidtrnti foe tela prooree (If Jfi or akip to 0) 

1. U ffl " tq text gccnit tha Uftauaoa(a) le/arai 

a. tooliah only 

6. Target lenfuaeafal only 

o. tnellaa and tercet laneoeeetaj 
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TO SOKE ' */r 



*• C o— un ity (uc^;i» if* incl^o^l 4. jwuvid* .ni or ac- 
tion to protpoctiva atuuanta 

Tha coaavjnity r«jourcaa ua«J 4f#i 

a. looto and TV (If no oc DO XO? ?nqw a«ip to 2) 
a.i rnqiitn only 
• .2 Tarqtt Un9u*9a<a) cniy 
a. J Cn^l.An and tar?*t ianjoagafaj ' 

O. NMpiptri itf j£ Of DO MOT know amp to :i 

/ b.: tnqli«h iaitQuaja only 

». 2 Tareat i«A9u«9«(«) only 

o.J Both £09 Ua* and tar 9 at Un«iM9«<al 

c. social oc<jannattona ;Xf Ng or 3ft_aflX 
ffjOf snip to 0) 

c.l Social Mrvico aqanciaa 

c.J (tonic clot* 

e.J Outraach racroitaant staff 

c. 4 Othar fracifvl 



0, Ail stw-anta arc «ncour«9od to antar too proqrao in* 

cijcUflajs 

1, Halaa 

a. r«iiM 

3. fcUuiie 9ioupO'livin9 in tha »h 

4. MCM living ia Ult ir«i 

5. Li.nl tad EAflian fpOAkirvf 
f. Haiidicappod 

IK. AMISSION HKXmXZS FCR THIS PftXSfUfl ARE OP€RAT!CNAL 

A. Acadoalc praraquiaitaa ara apaciftad foe atudanta .If 
^ aki» to X» if Yjft or TO 3CNI MOM tip Urvjuaqata) 
l a/art 1 



TO SONS 



1. Cf*9lU* oaUy 

2. Taraat lafljuoca) pi. a mm Cn9llah know 1009a 

3. tmjllalt plot aoa* kftovlatlja of tar9at lanqaaaata; 

4. Ta*9«t l.n9«M9*<i) only 

a. Studaata enrolled in the oreajre* ara at proper irada 
1ml aa eeocifiad in too Cour a* Coal a Oiractory - 
•nolle ftcnoela ltW-ai 
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: * *■ "Mtion ;astif 4C4t;^n AVAi*«*.*A car »Acr» 

•tudont rot tnrjllM *t *n4A la.-si? * 



3. Tnt idaiuijA ?rcc*iu'*a *r« <is/«*oe«d of • 

CMt spf ly> 

Adsnnistr stota 
2. Advisory CoMittaa 

)• CCuAASloia • 

<• Tsaonacs 



U-nsc* ill 



1. OtMr <spocify>_ 



S. ?MChcri|ii assist in ths «sl*ction of studsnts wno 

SAtS* UM pTOSTA* 

X. CLASS MOU/COT IS A ftCTC* >*!CH PEWITS T>€ ATTAIN- 
*BtT Of PPJXaW QURTIVCS SY EACH STU»T 

A* * Oom tbs Mwotr of pttMM *Axolls<i in tbt olm psr- 
•Jit cm itUinaMt of ffOf'M aojsctivss? 

a*. IW7HUC7I0N IS CMUNIZa) IN ORDER 70 ASSIST SNDBITS IN 

-eetjng p*ogaa* objectives 



tthst ui too ?t adorn nan t Mthodfsi of instruction? 

1CMC* Sll tAAt Apply) 

*• A tpoclf lid Period of tios it sllossts* to oscA 

sours* anlt Mi stydsjitA Art sipoetsd eo ststsr 
tM AAtoriAi wiUiA a tiM poriod itin osaao) 



Instruction ii vsrisd to acci 
iMroAftf stylss of studsnts 



ts individual 



__J. Studonta projrsAs at Uoir ova rata through a 

1ST ISA Of tAAAA (OOApOtAACy*OAAOd) 



T»s UnqoAOtU) in tM instruction of atudtnta la/arts 

iOASCS 9M| 

1. CAfllAA only 

2. Taroot lAAAuA^ait) only 

tnfliaA and uroot lAAfuoftUl 

TM inatructioAAl staff is BQApoaad of i tchsct ona) 

_1. iAStrootor «M tpoAU tnallsA only 

instructor «t*o samm Bivjlisft •ndtsrjst 

Ms) (AfOAlfy) 



instructor who apoaka fnfliaA only and a 
PArApfoftAAiOAAl woo spOASA CmIiaA and 
tArftt UoAtfAfOlAl jAAMlfy) « 



I as tr wo tor and a par A pr of aoa iooa 1 who spoon cna- 

llAA AIM tAffAt llAMAAMA) (tpAOify) 

insttuoMt r>Af AprofotaloAAl 



XAAUACtOC AM AJAjMA tMllAA AM SOMAS 

UnfuofO(A) and ■ pot opt Af saaiomI apAsninf 

AM 11 AA Mly (MMlfvl 
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'II. 



0. *n*t la the •?« tao«i.n»iU -wtr.w wi evaluation in 
tftii proar**? . ,chec* df**J 

1. a student'* eotforoance la :o»»pe« vd ^.cn 
ttvat of otnar rtudenta ifiota-retetancedi . 

3. A student" i ci((mnwi .s coapated rfitn 
K * a predetermined ataoderd tcriterion rer- 

•c enced) . 



t* »iodent o«(|jniX*tion eetlvitiea are in/cXuded in tne pco- 
*raa'e instructional ccevonent 

r. the vocational student t>r<?4Ai2at*ons 4* • lupported ay 
ouddatad school* funda. 

0. cooperative or on- t ft e* 30© instruction 1% provided far 
•11 • ca vmm 
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PIACBW SERVICES A*E PVW10ED TO PAOGWM C<m£TER5 OR 
LEAVERS 

A. Tne piMMiAt ol etudents is tit* reeponaiollity ofi 
iUt«ci alX mat apply) 



vocational mat rue tor 
Cooperative education coordinator 
Guidenct c oy not lo r 

OCCUpOtlOAOl Specialist 

Sudan t tuaaalf/hareelf 
Dlrectot/'rlnolpel 
County supervisor 
Other tapaoifyl 



3. 

a 

7. 

I. 



s.^The placement of atudenta wfto ooapletaor iaava toe ? roe can 
is further wanted by the following himiiii ,chec* all 
that apply* 



riot i«a I carta ■aployoent services 

Advianry Co— it tea* sanCexa 

Potential esa> Invars in buainata and induatxy 

ethnic troop orfanlsetiona 

Mom of the aba* a 

OoA't know 

Other taoocifvl - 



Aid for plaoaoaftt id provided for pr°«"* leaver e and 
coaplatare.' 

I. Aid) la srovidad aajually fort 
a. tela* 
a. reoalee 

a. Minority etanle frowa a sn n s r a 
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d. mnor.t/ *«cs *%«t« 

s. Uaitsd tnq*i»a ipsstina 

f. oandicjRfctd^ 

,XUI. DATA FROI FCtUOK-UP STUDIES ARE USED TO W£ DECISIONS REGARD- 
ING CUttiCULAR Af© PROGRAM REVISE 



itudtnts irs irtfors 
studies 



1 of th« iapor tines of follov-up 



a. Students art mfcxnsd of fcil^up procedures 

C. Tsachers/ mat: jctocs rscsive placaasnt t follow-up .nfori 
scion froa *tuO«nts sod saploysrs sacn ^ui 

o. If rcg oc TO 30WE PCGna . how is mis inforasuo* as ad? 
tc&ack sll tnat Apply) 



1. Msfcing proofs*) changes 

2. Oiscum with tchool/collsoe adtsimsers'cors 

1. Shan no with faaxd of Trustees (C.C.lsvsl only J 

4. SluxlOf with Advisory Coasnttea 

5. that ins, with • cud sues currently enrolled in tfte 
prosraa % 

c. taacasrs assise in coatsctinsj tot—* studs* ts 

XIV. ACMIfllSTRATORS AM) SUPERVISORY PTOOMCL PROVIDE ASSISTANCE 
IN rttQW MMKTENAMtt AM) WCyBWT 

A. Hsvs administrative oc supervisory parsons provided direct 
assistance Co mis prooraa? 

a. If XH IS MBI MHB ' M^iMiittflBi provided when 
. requested? 

C. If XH °* SB 30111 BSMi » assistance ves providsd oyi 



-< - - 



Nature of Aeslstancs 
{choc* ill that apply) 



tnatxuctional 
*athods 



Local Qirsctor of vo- 
cational Education 

2. County level Vocation- 
si JuoervUoc 

3. School ninclpAl or 
Cirsctbf 

4. Assistant Principal 



5. Other (Specif yji 



Program 

Contents 



Instructional^ 
assouccsf 



Others 
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WJtTMTitS C C* STArf IMPROVEMENT ^ W/irED IN 



A ~ra tna mrf 4tvoiof*ont sf : (actor i in ».r. aj- 
ar oar a* iiitiiM? (If S£ or CO PiO . to- 
Ci 

1. TIM auff JOVOlOOOOItt tlOOdO of thoaa rOtpOAOlOi.0 foe 

thu proora* oca aoooaaod xa tno foii«3*iftq aroaaj 
1« Cultural oador a Landing 

X, VOC4CU9M; UpdOCO 

3. roraxon Unfuoio asxi^a 1 

4. JnoUao Uofuafo atillo 
S> Inouuecionol ootAodolofy 

4. Otr.tr ne,«cifvl 



TO 30HI 



C. Inoarvica atoff dovolopoanc worfcanopo ara provided _ 

S. lAoor/xca tdoxnxotxatxva oovalopoont vorkoAopo ara 

provxdod — — _ 

I, Local fonda ara provxdod for trovol to ataffc iavoiop- 

mmmt actxvxtiaa _ _ 

XVI. Silt^TlVC EVAUUTIQN (to tbo boat of your fnoviodod) 

A* Tfco parconcofo of atudoota tftat cooqIoco your proqraa) :at ' 

a. rta»poretAtaoo of eoaolotars that aro oaployod In tna fiaid 
for -oxen tnoy rocoxvod training or ralatod arooo irst 

C. tno poreontooo of atjdouta *fto io not coomUat* ti>o proarao 
lioavoco) xsi 

0. k Tho porcoataqa of Uavora tftat aro oaployod in tno, flold foe 

wftiofi choy rooaxvod txaxnxno or a roiatod oroa iot 

C. mo porcantaoo of Joaplataro and/or loavota that aro jnaoio 
co onto* tno labor aarkot (0.9. » xoroxgn atuttootai ;as 

XVSI. INCiEOCI CF OUTSTANDING 3U0CSSS OF PAflTlCJPAKTS (OPTIONAL) 

:f tnora aro any aooalil atjdtnta you «ould lika to oontxoo', pioaao 
9xva xotorootxoA about too atudont'a auceooo - ooattonino; vnat <und 
of aueooao «aa acoiavod, x& wnat fiaid auceooa waa/obtaxAod* and way 
you boiiovo ha/ano woo ao outatanding auceaaa. 



ftcconc 
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272 w 



J * :: ' :<jr " • /cur ..-.cat *iu w* aoij to -eve oo . *s\:.* 



School: 



Ur^agea iooKtn xn your classics) 



2) 



4) 



Lthcus 3roupa in Clan .as* <s.g., Mexican, Caoan.> 

1) 

* 2* 



5J 



P.S.J, vocational Id ^ca tier. Study 
Coc^^an* No. 4.: 
•HAM - 2/31 
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1. *ert 5»* on ire £elf ~!/aluati«.n f^r:? ..eir i* a 



If * rlt suggestions wouli you ma** '.3 ifcrove ,ne.r? 



« J . *as the Inforaation fcr Cosrltting tht Self-Study Torn clear 
inc txplicit? 

If 'jo, what suggestions would you aafce to i»nprcve thea? 



3. wtrt tr.tr • any standards and/or criteria -.nat yo« fc#i:ove 
should oe *dde4 or delete* tizn this instrument? 

please, specify them; 



4, Co you fcelieve this instruaentull provide the' following 
information: 

a. Dettrrpir.e if the program meets the needs » interests* 
and abilities of student*. 

* If No» 'what addition would you suggest to obtain 
this information? 



Seteraine if che progrun satisfies the requirements 
of the occupation or occupational field in which the 
training ia given. 

li i*2» what additions would you suggest to obtain this 
information? ' 
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Detcr-L * if tne progcua aeets the? c*quiroi*ncj lee cor 
iy tlie 5t~ - Boac-i of Education tot the operation /oca- 
ncnal edu.aticn ncograaw and tneic r«iat*i ir**3. 

If >o. vnat suggestions would you -iaae to obtain this 
information? 



Oo you have <py other suggestions that* would improve this ir.str^.ent? 

ilf any, please specify): 



32b ^ 
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